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■ (57) The present invention makes it possible to 
achieve data adaptation in accordance with a user's 
preferences, by holding a user's preference information 
for each content as user preferences, selecting a data 



segment according to user preferences, and performing 
resolution conversion on the basis of segment priority 
level and terminal capability, thereby enabling data ad- 
aptation to be performed for each content in a form the 
user wishes to see. 
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Description 

Technical Field 

[0001] The present invention relates to a data adap- 5 
tation apparatus and data adaptation method for adapt- 
ing data to the preferences of a user, and a recording 
medium that includes a data adaptation apparatus. In 
particular, the present invention relates to a data adap- 
tation apparatus for data including video, audio, and 10 
documents provided via broadcasting or communica- 
tion media such as digital broadcasting or the Internet. 

Background Art 

15 

[0002] In recent years, there has been an active trend 
of digitization of broadcasting, and fusion with com- 
munications has also progressed. In the field of commu- 
nications, sateiliLe digital broadcasting has already been 
started, and it is expected that terrestrial broadcasting 20 
will also be digitalized in the future. As a result of digi- 
talization of broadcast contents, data broadcasting is al- 
so performed in addition to conventional video and au- 
dio. Products that realize the concept of storing televi- 
sion broadcasts on a hard disk and playing them back 25 
later (TV Anytime), such asTiVo (www.tivo.com)and Re- 
playTV(www.replaytv.com),are also on the market in the 
United States. Also, in the communications field, digital 
content distribution via the Internet has begun with mu- 
sic, and the number of Internet broadcasting stations 30 
that broadcast video is also increasing. In addition, ac- 
cess to Internet content has also been made possible 
for portable terminals through wideband access net- 
works and connection to the Internet. 

[0003] Amid such dramatic changes in information in- 35 
frastructure, it is envisaged that henceforth it will be- 
come possible for users to easily access enormous in- 
formation sources including video, audio, documents, 
and the like. Due to the fusion and digitalization of com- 
munications and broadcasting in this way, it has become 40 
difficult for users to handle enormous information sourc- 
es without selectively transmitting and replaying only in- 
formation that accords with the preferences of a user by 
using metadata that describes content. As shown in 
"Adapting Multimedia Internet Content For Universal ^5 
Access" (IEEE Transactions on Multimedia, March 
1999, pp. 104-114), there have been proposed a de- 
scription scheme for distributing one content to various 
terminals such as televisions and portable terminals, 
and accessing rich content on the Internet from an HHC so 
(Hand Held Computer), PDA (Personal Digital Assist- 
ant), Smart Phone, or the like, and a method for con- 
verting (performing data adaptation of) Internet content 
according to the display capability of a terminal (for ex- 
ample, by changing the display size or number of display 55 
colors). 

[0004] A conventional data adaptation apparatus will 
be described below. FIG.68 shows a block diagram of 



a conventional data adaptation apparatus. A conven- 
tional data adaptation apparatus consists of a data ad- 
aptation section 100, a policy engine 101, a content 
analysis section 102, a content selection section 103, a 
content manipulation section 104, and a terminal 105. 
Internet content d1001 is input to the content analysis 
section 102. Terminal preferences d1002 that indicate 
terminal 105 performance information are stored in the 
terminal 105. 

[0005] FIG.69 is a detailed drawing of terminal pref- 
erences d1002. Terminal preferences d1002 contain 
screen color number information x and screen size in- 
formation axb indicating the display capability of the ter- 
minal 105, 

[0006] The operation of a data adaptation section 
configured as described above will be described below 
using FIG, 70. FIG. 70 is processing flowchart that de- 
scribes the operation of the data adaptation section 100. 
[0007] The policy engine 1 01 identifies the display 
screen size and number of display colors as the terminal 
capability according to terminal preferences d1002 ob- 
tained from the terminal 105 (P1 201). The policy engine 
101 then controls the content selection section 1 03 and 
content manipulation section 1 04 according to the infor- 
mation and policy identified in P1201. 
[0008] The content analysis section 1 02 analyzes the 
physical data type of Internet content d1001 requested 
by the user (P1 202). Then, the content selection section 
103 judges whether display of the Internet content 
d1001 is possible with the display capability of the ter- 
minal 105 (P1203), and if the capability is sufficient to 
display the Internet content d1 001 , selects only content 
that can be displayed with the terminal capability from 
the Internet content d1 001 (P1204). 
[0009] Then, the content manipulation section 104 
further converts the displayable content selected in 
P1204 to a form that can be displayed with the terminal 
capability. Specifically, the content selection section 
1 03 judges whetherthe content is largerthan the display 
screen size (P1205), and content largerthan the display 
screen size is reduced in size by the content manipula- 
tion section 1 04 (P1 206). If the content is not largerthan 
the display screen size, the content manipulation sec- 
tion 1 04 judges whether the content is smaller than the 
display capability (P1207), and small content is en- 
larged by the content manipulation section 104 (P1208). 
[0010] The content manipulation section 104 also 
judges whether the number of display colors of the ter- 
minal 105 are colors (P1209). Then, if the number of 
display colors of the terminal 1 05 are not colors, the con- 
tent manipulation section 104 judges whether they are 
gray-scale (P1 21 0), and if they are gray-scale, converts 
the content number of colors to gray-scale (P1 21 1 ), and 
if they are neither colors nor gray-scale, performs binary 
conversion (P1212). 

[0011] However, with the above-described conven- 
tional technology, a general policy is carried out-that is, 
selection and manipulation of content based on the re- 
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suit of content analysts in accordance with a policy suit- 
ed to a specific terminal. Consequently, there is a prob- 
lem in that it is only possible to perform data adaptation 
according to a predetermined fixed number of terminal 
patterns. s 
[001 2] Also, with the conventional technology it is not 
possible to perform selection and manipulation of con- 
tent according to the preferences of the user: for exam- 
ple, selection and manipulation to display part of an im- 
age rather than reducing it in size. Therefore, with the w 
conventional technology, even in a case where content 
selection and manipulation are performed using a pre- 
determined specific terminal, there is a problem in that 
the user cannot perform data adaptation of content in a 
form according to his or her preferences using that ter- is 
minal. 

Disclosure of Invention 

[001 3] It is a first objective of the present invention to 20 
perform data adaptation of content in a form according 
to the user's preferences by selecting a data segment 
according to user preference information. 
[001 4] It is a second objective of the present invention 
to perform data adaptation of content, when content is 25 
distributed via a network, in a form in which the user 
wishes to receive it and in a scalable fashion according 
to the network status. 

[0015] In order to meet the above-described first ob- 
jective, the present invention performs data adaptation 30 
in a form the user wishes to see for each content by hold- 
ing user preference information as user preferences : se- 
lecting a data segment according to the user preferenc- 
es, and performing resolution conversion on the basis 
of the segment priority and terminal capability. By this 35 
means, it is possible to perform data adaptation fully in 
accordance with the user's preferences. 
[0016] Also, in order to meet the above-described 
second objective : the present invention performs data 
adaptation of content in a form in which the user wishes 40 
to receive it and in a scalable fashion according to the 
network status by acquiring information on the network 
transmission band as a network preference when con- 
tent is distributed via a network, and adjusting the data 
quantity according to the segment priority and transmis- -*s 
sion band. By this means, it is possible to perform data 
adaptation in a form in which the user wishes to receive 
it and in a scalable fashion according to the network sta- 
tus. 

50 

Brief Description of Drawings 
[0017] 

FIG.1 is a block diagram of a terminal provided with 55 
a data adaptation apparatus according to Embodi- 
ment 1 and Embodiment 3 of the present invention; 
FIG. 2 is a detailed drawing of user preferences ac- 



cording to Embodiment 1 ; 

FIG.3 is a drawing showing description definitions 
of user preferences according to Embodiment 1 ; 
FIG.4 is a drawing showing a sample description of 
user preferences according to Embodiment 1 ; 
FIG. 5 is an explanatory drawing of the operation of 
the segment selection section according to Embod- 
iment 1 ; 

FIG.6 is a processing flowchart of the user adaptive 
control section according to Embodiment 1; 
FIG. 7 is a processing flowchart of the terminal 
adaptive control section according to Embodiment 
1; 

FIG. 8 is a block diagram of a system provided with 
a data adaptation apparatus according to Embodi- 
ment 2 and Embodiment 4 of the present invention; 
FIG .9 is a processing flowchart of the network adap- 
tive control section according to Embodiment 2; 
FIG.1 0 is a detailed drawing showing a second ex- 
ample of user preferences; 

FIG.1 1 is a detailed drawing showing second de- 
scription definitions of user preferences; 
FIG.1 2 is a detailed drawing showing a second 
sample description of user preferences; 
FIG.1 3 is a drawing explaining second operatiomof 
the segment selection section; - 
Fig. 14 is a flowchart of second processing of the 
user adaptive control section; 
FIG.1 5 is a block diagram showing another exam- 
ple of a system provided with a data adaptation ap- 
paratus according to an embodiment of the present 
invention; 

FIG.1 6 is a drawing showing another mode of seg- 
ments according to an embodiment of the present 
invention; 

FIG.1 7 is a drawing showing examples of segment 
descriptions according to an embodiment of the 
present invention; 

FIG.1 8 is a drawing showing the data structure ac- 
cording to Embodiment 5 of the present invention; 
FIG.1 9 is a drawing showing an example of data 
descriptions according to Embodiment 5 of the 
present invention; 

FIG.20 is a drawing showing another example of the 
data structure according to Embodiment 5 of the 
present invention; 

FIG. 21 is a drawing showing another example of 
descriptions of the data structure according to Em- 
bodiment 5 of the present invention; 
FIG .22 is a drawing showing the data structure ac- 
cording to Embodiment 6 of the present invention; 
FIG. 23 is a drawing showing an example of data 
descriptions according to Embodiment 6 of the 
present invention; 

FIG. 24 is a drawing showing the data structure ac- 
cording to Embodiment 7 of the present invention; 
FIG. 25 is a drawing showing data descriptions ac- 
cording to Embodiment 7 of the present invention; 
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FIG . 26 is a drawing showing another example of the 
data structure according to Embodiment 7 of the 
present invention; 

FIG. 27 is a drawing showing another example of 
descriptions of a data structure according to Em- 5 
bodiment 7 of the present invention; 
FIG. 28 is a drawing showing the data structure ac- 
cording to Embodiment 8 of the present invention; 
FIG. 29 is a drawing showing data descriptions ac- 
cording to Embodiment 8 of the present invention; w 
FIG. 30 is a drawing showing another example of the 
data structure according to Embodiment 8 of the 
present invention; 

FIG. 31 is a drawing showing another example of 
descriptions of a data structure according to Em- is 
bodiment 8 of the present invention; 
FIG. 32 is a first drawing showing description defini- 
tions of user preferences according to Embodiment 
9 of the present invention; 

FIG. 33 is a second drawing showing description 20 
definitions of user preferences according to Embod- 
iment 9 of the present invention; 
FIG. 34 is a drawing showing a sample description 
of user preferences according to Embodiment 9 of 
the present invention; 25 
FIG. 35 is a first drawing showing segment descrip- 
tion definitions according to Embodiment 9; 
FIG. 36 is a second drawing showing segment de- 
scription definitions according to Embodiment 9; 
FIG. 37 is a third drawing showing segment descrip- 30 
tion definitions according to Embodiment 9; 
FIG. 38 is a drawing showing a first sample segment 
description according to Embodiment 9; 
FIG. 39 is a drawing showing a second sample seg- 
ment description according to Embodiment 9; 35 
FIG. 40 is a drawing showing a third sample seg- 
ment description according to Embodiment 9; 
FIG, 41 is a drawing showing a fourth sample seg- 
ment description according to Embodiment 9; 
FIG. 42 is a drawing showing a fifth sample segment 40 
description according to Embodiment 9; 
FIG. 43 is a drawing showing a sixth sample seg- 
ment description according to Embodiment 9; 
FIG. 44 is a drawing showing a seventh sample seg- 
ment description according to Embodiment 9; -*5 
FIG. 45 is a drawing showing an eighth sample seg- 
ment description according to Embodiment 9; 
FIG. 46 is a drawing showing a ninth sample seg- 
ment description according to Embodiment 9; 
FIG. 47 is a first drawing showing user preference so 
description definitions according to Embodiment 1 0 
of the present invention; 

FIG. 48 is a second drawing showing user prefer- 
ence description definitions according to Embodi- 
ment 10; 55 
FIG. 49 is a third drawing showing user preference 
description definitions according to Embodiment 
10; 



FIG. 50 is a fourth drawing showing user preference 
description definitions according to Embodiment 
10: 

FIG. 51 is a fifth drawing showing user preference 
description definitions according to Embodiment 
10; 

FIG. 52 is a drawing showing a sample user prefer- 
ence description according to Embodiment 10; 
FIG. 53 is a first drawing showing segment descrip- 
tion definitions according to Embodiment 10; 
FIG. 54 is a second drawing showing segment de- 
scription definitions according to Embodiment 10; 
FIG. 55 is a third drawing showing segment descrip- 
tion definitions according to Embodiment 10; 
FIG. 56 is a fourth drawing showing segment de- 
scription definitions according to Embodiment 10; 
FIG. 57 is a first drawing showing a sample segment 
description according to Embodiment 10; 
FIG. 58 is a second drawing showing a sample seg- 
ment description according to Embodiment 10; 
FIG. 59 is a third drawing showing a sample seg- 
ment description according to Embodiment 10; 
FIG. 60 is a first drawing showing another example 
of a segment description according to Embodiment 
10; 

FIG. 61 is a second drawing showing another exam- 
pie of a segment description according to Embodi- 
ment 10; 

FIG. 62 is a first drawing showing digest description 
definitions according to Embodiment 11 ; 
FIG. 63 is a second drawing showing digest descrip- 
tion definitions according to Embodiment 11; 
FIG. 64 is a third drawing showing digest description 
definitions according to Embodiment 11 ; 
FIG. 65 is a fourth drawing showing digest descrip- 
tion definitions according to Embodiment 11; 
FIG. 66 is a drawing showing an example of a point 
of view list description according to an embodiment; 
FIG. 67 is a drawing showing an example of a digest 
description according to Embodiment 11; 
FIG. 68 is a block diagram of a conventional data 
adaptation apparatus; 

FIG. 69 is a detailed drawing of a conventional ter- 
minal preference description; and 
FIG. 70 is a processing flowchart of a conventional 
data adaptation section. 

Best Mode for Carrying out the Invention 

[0018] With reference now to the attached drawings, 
embodiments of the present invention will be explained 
in detail below. 

(Embodiment 1 ) 

[0019] A terminal provided with a data adaptation ap- 
paratus according to Embodiment 1 of the present in- 
vention will be described below. F1G.1 is a block diagram 
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of a terminal provided with a data adaptation apparatus 
according to Embodiment 1. As shown in FIG.1, a ter- 
minal 1 0 is composed of a content data storage medium 
11 on which is stored data d102 consisting of content 
composed of a plurality of segments and metadata d 1 01 
which is information for describing the datad102 : a user 
preference storage section 19 that stores user prefer- 
ences d103 which comprise information relating to the 
user's preferences, a terminal preference storage sec- 
tion 20 that stores terminal preferences d104 which 
comprise terminal capability information, and a user ad- 
aptation section 12 that adapts the data d102 to the us- 
er's preferences using the metadata d101, user prefer- 
ences d103 ; and terminal preferences d104. 
[0020] The user adaptation section 12 is provided with 
means for acquiring various kinds of data. Provided as 
means for acquiring various kinds of data are a content 
data acquisition section 21 consisting of a metadata ac- 
quisition section 21a that acquires metadata d101 and 
a data acquisition section 21b that acquires data d102, 
a user preference acquisition section 22 that acquires 
user preferences d103, and a terminal preference ac- 
quisition section 23 that acquires terminal preferences 
d104. 

[0021] In addition, the user adaptation section 12 is 
provided with means for selecting a predetermined seg- 
ment from the data d102 acquired in accordance with 
the user's preferences and adapting it to the user's pref- 
erences. Provided as means for adapting a selected 
segment to the user's preferences are a user adaptive 
control section 14 that generates information for select- 
ing a predetermined segment from acquired data d102 
using acquired metadata cfl 01 and userpreference data 
d103, and a segment selection section 16 that selects 
and extracts a predetermined segment from acquired 
data d102 on the basis of information generated by the 
user adaptive control section 14. 

[0022] Moreover, the user adaptation section 12 is 
provided with means forconverting data d1 02 in accord- 
ance with the terminal capability of, for instance, a dis- 
play section 18 which is a data d102 processing appa- 
ratus. Provided as means for converting data d102 in 
accordance with the terminal capability are a terminal 
adaptive control section 15 that generates information 
for varying the spatial resolution and color resolution of 
data d102 from metadata d101 and terminal preferenc- 
es d104, and a resolution conversion section 17 that 
performs spatial resolution conversion and color reso- 
lution conversion for data d102 in accordance with in- 
formation generated by the terminal adaptive control 
section 15. 

[0023] Next, user preferences d1 03 will be described. 
FIG.2 is a detailed drawing of user preferences d103. 
As shown in FIG.2, user preferences d103 are com- 
posed of a plurality of user preference descriptions 3a 
to 3n . I n user preference descriptions 3a to 3n are stored 
a plurality of content identifiers 34 corresponding to 
each of user preference descriptions 3a to 3n, duration 



information 35 for displaying content at a desired time, 
and sets of keywords (user points of view) 36a and 36b 
for extracting a desired segment from content and pri- 
ority levels 37a and 37b corresponding to these key- 
5 words 36a and 36b. 

[0024] Next, a definition description of userpreferenc- 
es d1 03 including user preference descriptions 3a to 3n 
will be described in concrete terms. FIG. 3 is a drawing 
showing a definition description of user preferences 
10 d103. 

[0025] As shown in FiG.3, the user preference de- 
scription definition 40 is written using DTD (Document 
Type Definition) of XML (extensible Markup Language). 
[0026] The user preference description definition 40 

'5 defines there being at least one content item (Content) 
in the user preferences as indicated by reference nu- 
meral 41 in the drawing. Also, it is defined that there is 
at least one keyword (user point of view) 36 (Keyword) 
for each content item as indicated by reference numeral 

20 42 in the drawing. Further, a content identifier 34 (Con- 
tentlD), duration 35 (Duration), and screen size 46 
(ScreenSize) which is size information for displaying da- 
ta, are defined for the content as attributes as indicated 
by reference numeral 43 in the drawing. Also, the key- 

25 word 36 (Keyword) is defined as being written as text 
data as indicated by reference numeral 48 in the draw- 
ing, in addition, it is defined that there is a priority level 
37 (Priority) as an attribute for each keyword 36. 
[0027] Next, user preferences created using the user 

30 preference description definition shown in FIG.3 will be 
described. FIG. 4 is a drawing showing an example of 
user preferences. 

[0028] In FIG. 4, the item denoted by reference numer- 
al 50 is an example of an actual user preference descrip- 
35 tion written in XML using user preference description 
definition 40. 

[0029] User preferences 50 include two contents 51 
and 52. Content 51 has a content ID 53a (in this exam- 
ple, 123456789), and content 52 has a content ID 53b 
40 (in this example, 123456788). Also, content 51 includes 
a display duration 54 (in this example, smpte=00:05:00: 
00) as a content attribute. 

[0030] In addition, content 51 includes keywords (us- 
er points of view) 55a to 55c. Nakata is entered for key- 

^5 word 55a, Soccer for keyword 55b, and Japan for key- 
word 55c. Also, as attributes of keywords 55a to 55c, 
priority level 5 is entered for keyword 55a, priority level 
4 for keyword 55b, and priority level 2 for keyword 55c. 
[0031] Meanwhile, in content 52, a display scale 56 

so (in this example, pixel = 320x240) is entered as a con- 
tent attribute. In addition, content 52 includes keywords 
55d to 55f. Headline is entered for keyword 55d, Stock 
for keyword 55e, and Sports for keyword 55f. Also, as 
attributes of keywords 55d to 55f , priority level 5 is en- 

55 tered for keyword 55d, priority level 5 for keyword 55e, 
and priority level 3 for keyword 55f. 
[0032] Next, the configuration of the data d1 02 will be 
described using FIG. 5. 
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[0033] The data d102 is composed of a segment 61 
that comprises the time range of the data d1 02. The seg- 
ment 61 is composed of a first subsegment 62 and a 
second subsegment 63. Subsegment 62 is composed 
of a first subsegment 64 and a second subsegment 65, 
and subsegment 63 is composed of a first subsegment 
66 and a subsegment 67. Thus, the data d102 has a 
hierarchical structure comprising segments and sub- 
segments. 

[0034] Keywords (segment points of view) 621 are 
added to subsegment 62, and keywords (segment 
points of view) 631 are added to subsegment 63. Also, 
keywords (segment points of view) 641 are added to 
subsegment 64, keywords (segment points of view) 651 
are added to subsegment 65, keywords (segment points 
of view) 66 1 are added to subsegment 66, and keywords 
(segment points of view) 671 are added to subsegment 
67. 

[0035] Keywords 621, 631, 641, 651, 661, and 671 
are entered in the metadata d101. Also, a plurality of 
keywords (KWD) indicating the contents of segments 62 
to 67 corresponding to keywords 621, 631, 641, 651, 
661 , and 671 are assigned to keywords 621 , 631 , 641 , 
651, 661, and 671. 

[0036] A segment priority (segment priority level) is 
assigned to each keyword (KWD). In the example in the 
drawing, keywords 621 are composed of a set of 
KWD#2 and segment priority level 3 which is the ranking 
within KWD#2 : and a set of KWD#3 and segment priority 
level 3 which is the ranking within KWD#2. 
[0037] Next, the operation of the segment selection 
section 1 6 and the operation of the user adaptive control 
section 1 4 will be described using FIG. 5 and FIG. 6. FIG. 
5 is an operation explanation drawing that explains the 
operation of the segment selection section 16. FIG. 6 is 
a processing flowchart that explains the operation of the 
user adaptive control section 14. 

[0038] The content data acquisition section 21 of the 
data adaptation section 12 reads and acquires metada- 
ta d101 and data d102 from the storage medium 11. 
Then, the user adaptive control section 1 4 analyzes the 
acquired metadata d1 01 , extracts the data structure and 
at least one segment point of view to be added to each 
segment and the segment priority level at the segment 
point of view, and identifies the data (content) d1 02 that 
has been read (P701). 

[0039] Next, the user adaptive control section 14 se- 
lects the user preference description (for example, user 
preference description 31) corresponding to the identi- 
fied content from the user preferences d103 (P702). In 
addition, the user adaptive control section 14 arranges 
the user points of view (keywords) included in user pref- 
erence description 31 in order of priority, which is a user 
point of view attribute (P703). The user adaptive control 
section 14 then selects the user point of view that has 
been assigned the highest priority level (P704). 
[0040] Next, the user adaptive control section 14 
sends information to the segment selection section 16 



such that the segment that matches that user point of 
view is selected from the data d102, in order from the 
highest-priority user point of view (first user point of 
view). 

5 [0041] The segment selection section 16 then com- 
pares the first user point of view with the segment points 
of view of the segments, using the information sent from 
the user adaptive control section 1 4, and judges wheth- 
er there is a segment that has been assigned a segment 

10 point of view that matches the first user point of view 
(P705). 

[0042] Next, a transition is made to the operation to 
select a segment that has been assigned a segment 
point of view that matches the first user point of view. 

15 [0043] However, if all segments that have been as- 
signed a segment point of view that matches the first 
user point of view are simply selected, it is possible that 
the selected segments may exceed the restriction con- 
ditions of the duration information 54 or spatial range 

20 information 56, or both of these. Thus, in this embodi- 
ment, all segments that have been assigned a segment 
point of view that matches the first user point of view are 
first provisionally selected, and then a number of seg- 
ments that does not exceed the restriction conditions of 

25 the duration information 54 or spatial range information 
56, or both of these, is actually selected from the provi- 
sionally selected segments. 

[0044] To be specific, the segment selection section 
16 first provisionally selects segments that conform to 

30 the user point of view (P706), then the segment selec- 
tion section 1 6 judges whether provisional selection has 
been completed for all segments included in the meta- 
data d1 01 (P707), and if it has not been completed, ex- 
tracts the next segment using the metadata d101 , and 

35 performs processing P705 and P706. In this way, provi- 
sional selection can be performed for all the segments 
included in the data d102. 

[0045] Then, if the data adaptation section 1 2 judges 
in P707 that provisional selection has been completed 

■*o for all the segments, the provisionally selected seg- 
ments are arranged in the order of segment priority as- 
signed to the segments (P708).This is done in order to 
make the actual selection of segments starting from the 
segment with the highest segment priority level in the 

45 actual segment selection process that will be described 
later. 

[0046] First the data adaptation section 12 performs 
actual selection of the segment with the highest seg- 
ment priority (P709). Next, the data adaptation section 

so 1 2 judges whether actual selection has been completed 
for all provisionally selected segments (P710). Then, if 
the data adaptation section 12 judges in P710 that ac- 
tual selection has not been completed for all provision- 
ally selected segments, it judges whether the data 

55 length of the actually selected segments exceeds the 
restriction conditions of duration or spatial range, or both 
of these (P711). The data adaptation section 12 then 
repeats the operations from P709 to P711 as long as 
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these restriction conditions are not exceeded. 
[0047] If the data adaptation section 12 judges in 
P710 that actual selection has been completed for all 
provisionally selected segments, it judges whether 
processing has been performed for all user points of 
view (keywords) (P715). If the data adaptation section 
12 judges in P715 that processing has been completed 
for all user points of view, it terminates processing. If, 
on the other hand ; the data adaptation section 1 2 judges 
in P715 that processing has not been completed for all 
user points of view, a transition is made to processing 
for the next user point of view. 

[0048] Here : performing processing and selection 
again for segments already selected in the above-de- 
scribed processing would be pointless. Therefore, the 
data adaptation section 1 2 first extracts unselected seg- 
ments and performs the following processing on the un- 
selected segments only (P714). The data adaptation 
section 12 then selects the next user point of view 
(P713) and performs processing P705 to P711 . 
[0049] The segment selection operation will now be 
described in concrete terms using FIG. 5. First, the data 
adaptation section 12 looks for a subsegment with 
KWDtf 1 , which has the highest segment priority level of 
the user points of view ( keywords ) included in the user 
preferences (user preference description) 3. Keywords 
631 of subsegment 63 and keywords 661 of subseg- 
ment 66 both have KWD#1 . Next, the data adaptation 
section 12 adds a duration restriction to subsegment 63 
and subsegment 66, and makes a selection from sub- 
segment 63 and subsegment 66 in order of stringency 
of the duration restriction. To be specific, subsegment 
66 for which the duration restriction is not stringent-that 
is, duration is short-is selected with top priority as output 
data d102a. Then, subsegment 63 is selected as the 
segment making up output data 102b. 
[0050] Similarly, the data adaptation section 12 looks 
for a subsegment with KWD#2, which has the next-high- 
est priority level of the user points of view included in 
the user preferences 3. KWD#2 is included in all the sub- 
segments making up segment 61 . Therefore, it is nec- 
essary here to decide which subsegment is to be given 
priority. 

[0051] To be specific, the data adaptation section 12 
compares the segment priority levels of the segment 
points of view added to each subsegment. In the exam- 
ple in FIG. 5, subsegment 63, subsegment 62, subseg- 
ment 65, and subsegment 66 have the same priority, 
followed in priority by subsegment 64 and subsegment 
67. Since subsegment 67 has already been selected, it 
is omitted from the items subject to the following 
processing. 

[0052] Therefore, after the data adaptation section 1 2 
has selected output data d102b : if further duration re- 
strictions are permitted, subsegment 65, which has a 
higher segment priority level than subsegment 64, is se- 
lected in addition to subsegment 63 as a subsegment 
making up output data 102c. The remaining subseg- 



ment 64 includes KWD#2 and KWD#3, and has a lower 
segment priority level than subsegment 65. Therefore, 
when duration restrictions are most lenient, subsegment 
64 is selected in addition to subsegment 63 and sub- 
5 segment 65 as a subsegment making up output data 
stream 102d. 

[0053] The user adaptive control section 14 updates 
the priority level of a user point of view included in user 
preferences d1 03 that coincides with a keyword accord- 
10 tng to the priority level of the keyword added to a select- 
ed segment. 

[0054] In this way, it is possible to select segments 
suitable for user preferences d103 from data d102 ; and 
adapt data d1 02 to user preferences d1 03. 

'5 [0055] Next, the data adaptation section 12 shifts to 
an operation for converting the segments selected as 
described above according to the terminal preferences 
d1 04 that constitute terminal capability information. The 
operation of the terminal adaptive control section 15 will 

20 be described below using FIG. 7. FIG. 7 is a processing 
flowchart explaining the operation of the terminal adap- 
tive control section 15. 

[0056] First, the terminal adaptive control section 15 
acquires the terminal preferences d104 to be recorded 

25 in the terminal 1 0, and identifies the screen display size 
and number of display colors of the display section 18 
as terminal capabilities (P801 ). Next, the terminal adap- 
tive control section 15 determines the segment priority 
level that the segment selected by the segment selec- 

30 tion section 16 has as its own attribute (P802). Then the 
terminal adaptive control section 1 5 judges whether the 
selected segment is larger than the display capability of 
the display section 18 of the terminal 10 (P803). 
[0057] If the terminal adaptive control section 1 5 judg- 
es es in P803 that the selected segment is larger than the 
display capability of the display section 1 8 of the termi- 
nal 10, the terminal adaptive control section 15 adds a 
segment priority level to the terminal preferences d1 04, 
and determines whether to reduce the entire segment 

40 in size, display part of the selected segment, not display 
part of the selected segment, or convert part of the se- 
lected segment before displaying it (P804). 
[0058] If, on the other hand, the terminal adaptive con- 
trol section 1 5 judges in P803 that the selected segment 

45 is not larger than the display capability of the display 
section 1 8 of the terminal 1 0, the terminal adaptive con- 
trol section 15 judges whether the data of the selected 
segment is smaller than the screen display size of the 
display section 18 (P805). If the terminal adaptive con- 

so trol section 15 judges in P805 that the data of the se- 
lected segment is smaller than the screen display size 
of the display section 18, the terminal adaptive control 
section 15 adds a segment priority to the terminal pref- 
erences d104, and determines whether to enlarge the 

55 entire segment, enlarge part of the selected segment, 
not display part of the selected segment, or convert part 
of the selected segment before displaying it (P806). 
[0059] Next, the terminal adaptive control section 15 
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identifies the number of terminal display colors from the 
terminal preferences d104 : and, in accordance with the • 
number of terminal display colors, judges whether the 
segment for which processing P801 to P806 was exe- 
cuted is capable of color display by the display section 5 
1 8 (P807). If the terminal adaptive control section 1 5 de- 
termines in P807 that the segment for which the above- 
described processing was executed is capable of color 
display by the display section 1 8, processing is termi- 
nated. 

[0060] If , on the other hand, the terminal adaptive con- 
trol section 1 5 determines in P807 that the segment for 
which the above-described processing was executed is 
not capable of color display by the display section 1 8, it 
is determined whether the segment for which the above- 
described processing was executed can be displayed 
by the display section 18 after gray-scale conversion 
(P808).Then, if the terminal adaptive control section 15 
delermines thai the segment for which the above-de- 
scribed processing was executed is displayable by the 
display section 18 after gray-scale conversion, it is de- 
termined that the segment for which the above-de- 
scribed processing was executed is to be subjected to 
gray-scale conversion (P809). If the terminal adaptive 
control section 15 determines that the segment for 
which the above-described processing was executed is 
not displayable by the display section 18 after gray- 
scale conversion, it is determined that the segment for 
which the above-described processing was executed is 
to be subjected to binary conversion (P810). 
[0061] The resolution conversion section 17 then 
adapts the contents of the decision by the terminal adap- 
tive control section 1 5 for the actually selected segment 
and performs resolution conversion. Then the display 
section 1 8 displays the segment converted by the res- 
olution conversion section 17. 

[0062] As described above, according to Embodiment 
1 , one or more segment points of view added to seg- 
ments in the metadata d1 01 , and segment priority levels 
in the segment points of view, are extracted, and seg- 
ment selection can be performed based on the segment 
priority of segments that have a segment point of view 
that matches a user point of view included in the user 
preferences d103. By this means, it is possible to per- 
form data adaptation of data d102 fully in accordance 
with the user's preferences. 

[0063] Also, according to Embodiment 1 , it is possible 
to perform data adaptation fully in accordance with ter- 
minal capability by performing temporal and spatial res- 
olution conversion of segments according to terminal 
capability information included in terminal preferences. 
[0064] Moreover, according to Embodiment 1, the 
mode is such that a user priority level is assigned to each 
user point of view, and therefore relative user point of 
view priority levels can be changed by changing user 
priority levels alone. Consequently, editing of user 
points of view by the user is simplified. 



(Embodiment 2) 

[0065] A data adaptation apparatus according to Em- 
bodiment 2 of the present invention will be described 
below using FIG. 8. FIG. 8 shows a block diagram of a 
data adaptation apparatus according to Embodiment 2. 
[0066] In Embodiment 2, the user adaptive control 
section according to Embodiment 1 is provided with a 
server, and the server and terminals are connected by 
a network. However, simply providing network connec- 
tion of a user adaptive control section and terminals 
does not make it possible to perform data adaptation in 
a scalable fashion in the form the user wishes to receive 
and according to the status of the network. To solve this 
problem, in Embodiment 2, when distributing content to 
terminals via a network, the user adaptation section ac- 
quires information on the network transmission band as 
network preferences and adjusts the data quantity ac- 
cording to the segment priority and transmission band. 
In this way, Embodiment 2 enables data adaptation to 
be performed in a scalable fashion in the form the user 
wishes to receive and according to the status of the net- 
work. 

[0067] Embodiment 2 will now be described in detail 
below. The configuration of a data adaptation section 22 
according to Embodiment 2 will be described using FIG. 
8. FIG. 8 is a block diagram of a system provided with a 
data adaptation apparatus 22 according to Embodiment 
2. 

[0068] As shown in FIG. 8, a server 20 and terminal 
2B are connected by a network 2A. The terminal 2B is 
composed of a user preference storage section 30 that 
stores user preferences d103 which comprise informa- 
tion relating to the user's preferences, a terminal pref- 
erence storage section 31 that stores terminal prefer- 
ences d1 04 which comprise terminal 2B capability infor- 
mation, a network preference storage section 205 that 
stores network preferences d205 which comprise net- 
work 2A transmission band information, and a storage 
medium 2C that stores data sent from the server 20. 
[0069] The server 20 is composed of a content data 
storage medium 21 on which is stored data d102 con- 
sisting of content composed of a plurality of segments 
and metadata d101 which is information for describing 
the data d102, and a user adaptation section 22 that 
adapts the data d102 to the user's preferences using 
the metadata d101, user preferences d103, terminal 
preferences d104, and network preferences d205. 
[0O70] The user adaptation section 22 is provided with 
means for acquiring various kinds of data. Provided as 
means for acquiring various kinds of data are a content 
data acquisition section 33 consisting of a metadata ac- 
quisition section 33a that acquires metadata d101 and 
a data acquisition section 33b that acquires data d102, 
a user preference acquisition section 34 that acquires 
user preferences d103 via the network 2A, a terminal 
preference acquisition section 35 that acquires terminal 
preferences d104 via the network 2A, and a network 
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preference acquisition section 36 that acquires network 
preferences d205 via the network 2A. 
[0071] In addition., the user adaptation section 12 is 
provided with means for selecting a predetermined seg- 
ment from the data d102 acquired in accordance with 
the user's preferences and adapting it to the user's pref- 
erences. Provided as means for adapting a selected 
segment to the user's preferences are a user adaptive 
control section 24 that generates information for select- 
ing a predetermined segment from acquired data d1 02 
using acquiredmetadatad101 and user preference data 
d103, and a segment selection section 26 that selects 
and extracts a predetermined segment from acquired 
data d102 on the basis of information generated by the 
user adaptive control section 24. 
[0072] Moreover, the user adaptation section 24 is 
provided with means for converting data d1 02 in accord- 
ance with the capability of the terminal 2B which is a 
data d1 02 processing apparatus. Provided as means for 
converting data d102 in accordance with the terminal 
capability are a terminal adaptive control section 25 that 
generates information for varying the spatial resolution 
and color resolution of data d102 from metadata d101 
and terminal preferences d104, a resolution conversion 
section 27 that performs spatial resolution conversion 
and color resolution conversion for d1 02 in accordance 
with information generated by the terminal adaptive con- 
trol section 25, a network adaptive control section 28 
that generates information for adjusting the quantity of 
data d102 sent to the network 2A using the meiadata 
d101 and network preferences d205 f and a data quan- 
tity adjustment section 29 that adjusts the quantity of 
data sent to the network 2A according to information 
generated by the network adaptive control section 28. 
[0073] Next, the operation of the segment selection 
section 26 and the operation of the user adaptive control 
section 24 will be described using FIG. 6. 
[0074] The content data acquisition section 33 of the 
data adaptation section 24 reads and acquires metada- 
ta d101 and data d102 from the storage medium 21. 
Then, the user adaptive control section 24 analyzes the 
acquired metadata d1 01 , extracts the data structure and 
at least one segment point of view to be added to each 
segment and the segment priority level at the segment 
point of view, and identifies the data (content) d1 02 that 
has been read (P701 ). Next, the user adaptive control 
section 24 selects the user preference description (for 
example, user preference description 31) correspond- 
ing to the identified content from the user preferences 
d103 (P702). In addition, the user adaptive control sec- 
tion 24 arranges the user points of view (keywords) in- 
cluded in user preference description 31 in order of pri- 
ority level, which is a user point of view attribute (P703). 
The user point of view that has been assigned the high- 
est priority level is then selected (P704). 
[0075] Next, the user adaptive control section 24 
sends information to the segment selection section 26 
such that a segment that matches that user point of view 



is selected from the data d1 02, in orderfrom the highest- 
priority user point of view (first user point of view). 
[0076] The segment selection section 26 then com- 
pares the first user point of view with the segment points 
5 of view of the segments, using the information sent from 
the user adaptive control section 24, and judges wheth- 
er there is a segment that has been assigned a segment 
point of view that matches the first user point of view 
(P705). 

^0 [0077] Next, a transition is made to the operation to 
select a segment that has been assigned a segment 
point of view that matches the first user point of view. 
[0078] The segment selection section 26 first provi- 
sionally selects segments that conform to the user point 

'5 of view (P706). Then the segment selection section 26 
judges whether provisional selection has been complet- 
ed for all segments included in the metadata d101 
(P707), and if it has not been completed, extracts the 
next segment using the metadata d101, and performs 

20 processing P705 and P706. In this way, provisional se- 
lection can be performed for all the segments included 
in the data d102, 

[0079] Then, if the data adaptation section 22 judges 
in P707 that provisional selection has been completed 

25 for all the segments, the provisionally selected seg- 
ments are arranged in the order of segment priority as- 
signed to the segments (P708). This is done in order to 
make the actual selection of segments starting from the 
segment with the highest segment priority level in the 

30 actual segment selection process that will be described 
later. 

[0080] First, the data adaptation section 22 performs 
actual selection of the segment with the highest seg- 
ment priority level (P709). Next, the data adaptation sec- 

35 tion 22 judges whether actual selection has been com- 
pleted for all provisionally selected segments (P710). 
Then, if the data adaptation section 22 judges in P710 
that actual selection has not been completed for all pro- 
visionally selected segments, it judges whether the data 

40 length of the actually selected segments exceeds the 
restriction conditions of duration or spatial range, or both 
of these (P711). The data adaptation section 22 then 
repeats the operations from P709 to P711 as long as 
these restriction conditions are not exceeded. 

^5 [0081] If the data adaptation section 22 judges in 
P710 that actual selection has been completed for all 
provisionally selected segments, it judges whether 
processing has been performed for all user points of 
view (keywords) (P715). If the data adaptation section 

50 22 judges in P715 that processing has been completed 
for all user points of view (keywords), it terminates 
processing. If, on the other hand, the data adaptation 
section 22 judges in P71 5 that processing has not been 
completed for all user points of view, a transition is made 

55 to processing for the next user point of view. 

[0082] Here, performing processing and selection 
again for segments already selected in the above-de- 
scribed processing would be pointless. Therefore, the 
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data adaptation section 22 first extracts unselectecl seg- 
ments and performs the following processing on the un- 
selected segments only (P714). It then selects the next 
user point of view (P71 3) and performs processing P705 
to P711. 

[0083] in this way. it is possible to select segments 
suitable for user preferences d1 03 from data d1 02, and 
adapt data d1 02 to user preferences d1 03. 
[0084] Next, the data adaptation section 12 shifts to 
an operation for converting the segments selected as 
described above according to the terminal preferences 
d104 that constitute terminal capability information. The 
operation of the terminal adaptive control section 25 will 
be described below using FIG. 7. 

[0085] First, the terminal adaptive control section 25 
acquires the terminal preferences d104 to be recorded 
in the terminal 2B from the terminal preference acquisi- 
tion section 35, and identifies the screen display size 
and number of display colors of the display section 18 
as terminal capabilities (P801 ). Next, the terminal adap- 
tive control section 55 determines the segment priority 
level that the segment selected by the segment selec- 
tion section 26 has as its own attribute (P802). Then the 
terminal adaptive control section 25 judges whether the 
selected segment is larger than the display capability of 
the display section 1 8 of the terminal 2B (P803), 
[0086] If the terminal adaptive control section 25 judg- 
es in P803 that the selected segment is larger than the 
display capability of the terminal 2B, the terminal adap- 
tive control section 25 adds a segment priority level to 
the terminal preferences d1 04, and determines whether 
to reduce the entire segment in size, display part of the 
selected segment, not display part of the selected seg- 
ment, or convert part of the selected segment before dis- 
playing it (P804). 

[0087] If, on the other hand, theterminal adaptive con- 
trol section 25 judges in P803 that the selected segment 
is not larger than the display capability of the terminal 
2B, the terminal adaptive control section 25 judges 
whether the data of the selected segment is smaller than 
the screen display size of the terminal 2B (P805). If the 
terminal adaptive control section 25 judges in P805that 
the data of the selected segment is smaller than the 
screen display size of the terminal 2B, the terminal 
adaptive control section 25 adds a segment priority level 
to the terminal preferences d104, and determines 
whether to enlarge the entire segment, enlarge part of 
the selected segment, not display part of the selected 
segment, or convert part of the selected segment before 
displaying it (P806). 

[0088] Next, the terminal adaptive control section 25 
identifies the number of terminal 2B display colors from 
the terminal preferences d1 04, and, in accordance with 
the number of terminal display colors, judges whether 
the segment for which processing P801 to P806 was 
executed is capable of color display by the display sec- 
tion (P807). If the terminal adaptive control section 25 
determines in P807 that the segment for which the 
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above-described processing was executed is capable 
of color display by the terminal 2B, processing is termi- 
nated. 

[0089] If. on the other hand, theterminal adaptivecon- 

5 trol section 25 determines in P807 that the segment for 
which the above-described processing was executed is 
not capable of color display by the terminal 2B, it is de- 
termined whether the segment for which the above-de- 
scribed processing was executed can be displayed by 

10 the terminal 2B after gray-scale conversion (P808). 
Then, if the terminal adaptive control section 25 deter- 
mines that the segment for which the above-described 
processing was executed is displayable by the display 
section 18 after gray-scale conversion, it is determined 

15 that the segment for which the above-described 
processing was executed is to be subjected to gray- 
scale conversion (PB09). If the terminal adaptive control 
section 25 determines that the segment for which the 
above-described processing was executed is not dis- 

20 playable by the terminal 2B after gray-scale conversion, 
it is determined that the segment for which the above- 
described processing was executed is to be subjected 
to binary conversion (P810). 

[0090] The resolution conversion section 27 then 

25 adapts thecontents of the decision by theterminal adap- 
tive control section 25 for the actually selected segment 
and performs resolution conversion. Then the data sub- 
jected to resolution conversion is sent to the data quan- 
tity adjustment section 29. 

30 [0091] Next, the operation of the network adaptive 
control section 28 will be described using FIG. 9. FIG. 9 
is a processing flowchart of the network adaptive control 
section 28 according to Embodiment 2. 
[0092] The network adaptive control section 28 ac- 

35 quires from the network preference acquisition section 
36 network preferences d205 sent from the terminal 2B 
via the network 2A. Then the network adaptive control 
section 28 identifies the transmission band of the net- 
work 2 A (P901 ). Next, the network adaptive control sec- 

40 tion 28 determines the segment priority level that the 
segment selected by the segment selection section 26 
has as its own attribute (P902). The network adaptive 
control section 28 then judges whether the converted 
data is larger than the transmission band (P903). 

45 [0093] If the network adaptive control section 28 judg- 
es in P903 that the converted data is larger than the 
transmission band, the network adaptive control section 
28 determines whether to compress ail the data, trans- 
mit part of the data, not transmit all the data, or convert 

so part of the data before transmitting it (P904). Here, con- 
verting the data before transmitting it refers to format 
conversion such as converting MPEG1 data to MPEG4 
data or converting AAC data to MP3 data. 
[0094] If, on the other hand, the network adaptive con- 

55 trol section 28 judges in P903 that the converted data is 
not larger than the transmission band, the network 
adaptive control section 28 judges whether the convert- 
ed segment data is smaller than the transmission band 
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(P905). If the network adaptive control section 28 judges 
in P905 that the converted data is smaller than the trans- 
mission band, the network adaptive control section 28 
determines whether to perform additional transmission 
of untransmitted data, nottransmit, or transmit after con- 
verting or restoring conversion to its original state 
(P906). 

[0095] The data quantity adjustment section 29 then 
adapts the contents of the decision by the network adap- 
tive control section 28 for the actually selected segment, 
adjusts the data quantity, and transmits it to the terminal 
2B. The terminal 2B records the received segment in 
the storage medium 2C. 

[0096] As described above, according to Embodiment 
2, in addition to the effects of Embodiment 1 , by adjust- 
ing the selected segment data quantity according to the 
transmission band included in the network preferences 
d205, it is possible to perform data adaptation in a scal- 
able fashion in the form the user wishes to receive and 
in accordance with the status of the network. 

(Embodiment 3) 

[0097] A data adaptation apparatus according to Em- 
bodiment 3 of the present invention will now be de- 
scribed below. The configuration of the data adaptation 
apparatus according to Embodiment 3 is identical to the 
configuration of the data adaptation apparatus accord- 
ing to Embodiment 1 , and therefore a description of the 
configuration of the data adaptation apparatus accord- 
ing to Embodiment 3 will be omitted. 
[0098] The data adaptation apparatus according to 
Embodiment 3 and the data adaptation apparatus ac- 
cording to Embodiment 1 differ in the configuration of 
the user preferences d103. The user preferences d103 
according to Embodiment 3 will be described below. 
FIG. 1 0 is a second detailed drawing of user preferences 
d103. 

[0099] As shown in FIG. 10, user preferences d103 
are composed of a plurality of user preference descrip- 
tions 131 to 133. In user preference descriptions 131 to 
133 are stored a plurality of content identifiers 134 cor- 
responding to each of user preference descriptions 131 
to 133, duration information 135 for displaying content, 
and keywords 136a and 136b for extracting a predeter- 
mined segment from content. Thus, priority levels cor- 
responding to keywords 136a and 136b are not stored 
in the user preferences of Embodiment 3. This is a point 
of difference between the user preferences of Embodi- 
ment 3 and the user preferences of Embodiment 1 . 
[01 00] Next, a def in ition description of user preferenc- 
es d103 including user preference descriptions 131 to 
133 will be described in concrete terms . FIG, 11 is a 
drawing showing a definition description of user prefer- 
ences d1 03. 

[0101] As shown in FIG.11, the user preference de- 
scription definition 140 is written using DTD (Document 
Type Definition) of XML (extensible Markup Language). 



[0102] The user preference description definition 1 40 
defines there being at least one content (Content) in the 
user preferences as indicated by reference numeral 141 
in the drawing. Also, it is defined that there is at least 

5 one keyword 1 36 (Keyword) for each content as indicat- 
ed by reference numeral 142 in the drawing. Further, a 
content identifier 134 (ContentID), duration 135 (Dura- 
tion), and screen size 144 (ScreenSize)which is size in- 
formation for displaying data, are defined for the content 

^0 as attributes as indicated by reference numeral 1 43 in 
the drawing. Also, the keyword 1 36 (Keyword) is defined 
as being written as text data as indicated by reference 
numeral 148 in the drawing. 

[0103] It can also be see from the user preference de- 
'5 scription definition 140 in FIG.11 that a priority level cor- 
responding to the keyword 136 is not stored in the user 
preferences of Embodiment 3. 

[0104] Next, user preferences created using the user 
preference description definition shown in FIG.11 will be 
20 described. FIG. 12 is a drawing showing an example of 
user preferences. 

[0105] In FIG. 12, reference numeral 150 denotes an 
example of an actual user preference description written 
in XML using user preference description definition 40. 

25 [0106] User preferences 150 shown in FIG. 12 include ^ 
two content entities 151 and 152. Content 151 has a 
content ID 153a (in this example, 123456789), and con- - 
tent 152 has a content ID 153b (in this example, 
123456788). Also, content 151 includes a display dura- - 

30 tion 154 (in this example, smpte=00:05:00:00) as acon- 
tent attribute. In addition, content 151 includes key- 
words 155a to 155c. Nakata is entered for keyword 
1 55a, Soccer for keyword 1 55b, and Japan for keyword 
155c. 

35 [0107] Meanwhile, in content 1 52, a display scale 1 56 
(in this example, pixel = 320x240) is entered as a con- 
tent attribute. In addition, content 152 includes key- 
words 155d to 155f. Headline is entered for keyword 
155d, Stock for keyword 155e, and Sports for keyword 

40 I55f. 

[0108] Next, the configuration of data d1 02 according 
to Embodiment 3 will be described using FIG. 13. FIG. 
13 is an operation explanation drawing explaining the 
operation of the segment selection section 16. In FIG. 
45 13, the item denoted by reference number 131 is a user 
preference description. Apart from the user preference 
description 131, the configuration is similar to that of 
Embodiment 1 . 

[0109] Next, the operation of the segment selection 
so section 1 6 and the operation of the user adaptive control 
section 14 will be described using FIG. 13 and FIG. 14. 
FIG. 13 is an operation explanation drawing that ex- 
plains the operation of the segment selection section 1 6 . 
FIG. 14 is a processing flowchart that explains the oper- 
55 ation of the user adaptive control section 1 4. 

[0110] The content data acquisition section 21 of the 
data adaptation section 12 reads and acquires metada- 
ta d101 and data d102 from the storage medium 11. 
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Then, the user adaptive control section 1 4 analyzes the 
acquired metadata d1 01 , extracts the data structure and 
at least one segment point of view to be added to each 
segment and the segment priority level at the segment 
point of view, and identifies the data (content) d1 02 that 5 
has been read (P1 701 ). Next, the user adaptive control 
section 14 selects the user preference description (for 
example, user preference description 131 ) correspond- 
ing to the identified content from the user preferences 
d1 03 (P1 702). In addition, the user adaptive control sec- 10 
tion 14 arranges the user points of view (keywords) in- 
cluded in user preference description 131 in the order- 
in which they are written. In the example in FIG. 12, the 
keywords are arranged in order starting from the key- 
word written in the top line-that is, in the order keyword 15 
155a, keyword 155b, keyword 155c. Then the first user 
point of view-that is, the one written at the top-is selected 
(P1704). The reason for arranging the keywords in the 
order in which they are written in this way is that, since 
user priority levels are not assigned to user preferences 20 
d103 according to Embodiment 3, it is necessary to as- 
sign some kind of priority levels corresponding to user 
priorities. In Embodiment 3, the keyword priority levels 
are made to correspond to the order in which they are 
written, as a substitute for user priority levels. 25 
[0111] Next, the user adaptive control section 14 
sends information to the segment selection section 16 
such that a segment that matches that user point of view 
is selected from the data d1 02 ; in orderfrom the highest- 
priority user point of view (first user point of view). 30 
[0112] The segment selection section 16 then com- 
pares the first user point of view with the segment points 
of view of the segments, using the information sent from 
the user adaptive control section 1 4, and judges wheth- 
er there is a segment that has been assigned a segment 35 
point of view that matches the first user point of view 
(P1705). 

[0113] Next, a transition is made to the operation to 
select a segment that has been assigned a segment 
point of view that matches the first user point of view. 40 
[0114] The segment selection section 16 first provi- 
sionally selects segments that conform to the user point 
of view (P1 706). Then the segment selection section 1 6 
judges whether provisional selection has been complet- 
ed for all segments included in the data d1 02 (P1 707), 45 
and if it has not been completed, extracts the next seg- 
ment using the metadata d101 , and performs process- 
ing P1705 and P1706. In this way, provisional selection 
can be performed for all the segments included in the 
data d102. so 
[01 1 5] Then, if the data adaptation section 1 2 judges 
in P1 707 that provisional selection has been completed 
for all the segments, the provisionally selected seg- 
ments are arranged in the order of segment priority as- 
signed to the segments-(P1708). This is done in order 55 
to make the actual selection of segments starting from 
the segment with the highest segment priority level in 
the actual segment selection process that will be de- 
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scribed later. 

[0116] First the data adaptation section 12 performs 
actual selection of the segment with the highest seg- 
ment priority level (P1709). Next, the data adaptation 
section 12 judges whether actual selection has been 
completed for all provisionally selected segments 
(P1 71 0). Then, if the data adaptation section 1 2 judges 
in P1710 that actual selection has not been completed 
for all provisionally selected segments, it judges wheth- 
er the data length of the actually selected segments ex- 
ceeds the restriction conditions of duration or spatial 
range, or both of these (P1711). The data adaptation 
section 12 then repeats the operations from P1709 to 
P1 71 1 as long as these restriction conditions are not ex- 
ceeded, 

[0117] If the data adaptation section 12 judges in 
P1710 that actual selection has been completed for all 
provisionally selected segments, it judges whether 
processing has been performed for all user points of 
view (keywords) (P1 71 5). If the data adaptation section 
1 2 judges in P1 71 5 that processing has been completed 
for all user points of view, it terminates processing. If, 
on the other hand, the data adaptation section 1 2 judges 
in P1 71 5 that processing has not been completed for all 
user points of view, a transition is made to processing 
for the next user point of view. 

[0118] Here, performing processing and selection 
again for segments already selected in the above-de- 
scribed processing would be pointless. Therefore, the 
data adaptation section 1 2 first extracts unselected seg- 
ments and performs the following processing on the un- 
selected segments only (P1714). The data adaptation 
section 12 then selects the next user point of view 
(P1713) and performs processing P1705to P1711. 
[0119] The segment selection operation wilt now be 
described in concrete terms using FIG.1 3. First, the data 
adaptation section 12 looks for a subsegment written in 
the top line-that is with high-priority KWD#1 -within the 
user points of view (user keywords) included in the user 
preferences (user preference description) 131. Key- 
words 631 of subsegment 63 and keywords 661 of sub- 
segment 66 both have KWD#1 . Next, the data adapta- 
tion section 12 adds a duration restriction to subseg- 
ment 63 and subsegment 66, and makes a selection 
from subsegment 63 and subsegment 66 in order of 
stringency of the duration restriction. To be specific, sub- 
segment 66 for which the duration restriction is not strin- 
gent-that is, duration is short-is selected with top priority 
as output data d1 02a. Then, subsegment 63 is selected 
as the segment making up output data 102b. 
[0120] Similarly, the data adaptation section 12 looks 
for a subsegment with KWD#2, which has the next-high- 
est priority of the user points of view included in the user 
preferences d1 03. KWD#2 is included in all the subseg- 
ments making up segment 61 . Therefore, it is necessary 
here to decide which subsegment is to be given priority. 
[0121] To be specific, the data adaptation section 12 
compares the segment priority levels of the segment 
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points of view added to each subsegment. In the exam- 
ple in FIG. 13, subsegment 63, subsegment 62, subseg- 
ment 65, and subsegment 66 have the same priority lev- 
el, followed in priority by subsegment 64 and subseg- 
ment 67. Since subsegment 67 has already been se- 
lected, it is omitted from the items subject to the follow- 
ing processing. 

[01 22] Therefore, after the data adaptation section 1 2 
has selected output data d102b : if further duration re- 
strictions are permitted, subsegment 65, which has a 
higher segment priority level than subsegment 64, is se- 
lected in addition to subsegment 63 as a subsegment 
making up output data 102c. The remaining subseg- 
ment 64 includes KWD#2 and KWD#3, and has a lower 
segment priority level than subsegment 65, so when du- 
ration restrictions are most lenient, subsegment 64 is 
selected in addition to subsegment 63 and subsegment 
65 as a subsegment making up output data stream 
102d. 

[0123] The user adaptive control section 14 updates 
the priority level of a user point of view included in user 
preferences d103 that coincides with a keyword accord- 
ing to the priority level of the keyword added to a select- 
ed segment. 

[0124] In this way. it is possible to select segments 
suitable for user preferences d1 03 from data d1 02, and 
adapt data d1 02 to user preferences d1 03. 
[0125] Next, as in Embodiment 1, the terminal adap- 
tive control section 15 performs resolution conversion 
of the selected segment sent from the segment selec- 
tion section 16 in accordance with the flowchart shown 
in FIG. 7. 

[01 26] As described above, according to Embodiment 
3, it is possible to perform processing using the order in 
which user points of view are written for user point of 
view priority levels, without assigning user priority levels 
to the user preferences d103. By this means, it is pos- 
sible to perform data adaptation fully in accordance with 
the user's preferences in the same way as with Embod- 
iment 1 , without assigning user priority levels to the user 
preferences d103. 

[0127] Moreover, not providing user priority levels, as 
in Embodiment 3, simplifies the data structure of the us- 
er preferences d103. 

(Embodiment 4) 

[01 28] A data adaptation apparatus according to Em- 
bodiment 4 of the present invention will now be de- 
scribed below. In Embodiment 4, the user adaptive con- 
trol section in Embodiment 3 is provided in a server, and 
the server and terminals are connected by a network. 
[01 29] The system that includes a data adaptation ap- 
paratus according to Embodiment 4 has the same con- 
figuration as a system that includes a data adaptation 
apparatus according to Embodiment 2. Therefore, FIG. 
8 is a block diagram of a system that includes a data 
adaptation apparatus according to Embodiment 4. 
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[0130] The user preferences d103 according to Em- 
bodiment 4 are the same as in Embodiment 3. There- 
fore, the drawing shown in FIG. 10 is a drawing showing 
the user preferences d1 03 according to Embodiment 4. 
5 Also, FIG. 11 shows a definition of user preferences ac- 
cording to Embodiment 4. 

[01 31 ] The operation of the segment selection section 
26 according to Embodiment 4 is identical to that of the 
segment selection section 26 according to Embodiment 

10 3. Therefore, FIG. 13 is an operation explanation draw- 
ing that explains the operation of the segment selection 
section 26. In addition, FIG. 14 is a processing flowchart 
that explains the operation of the user adaptive control 
section 24 according to Embodiment 4. 

'5 [0132] Moreover, the operation of the terminal adap- 
tive control section 25 according to Embodiment 4 is 
identical to that of the terminal adaptive control section 
according to Embodiment 3. Therefore, FIG. 7 is a 
processing flowchart explaining the operation of the ter- 

20 minal adaptive control section 25 according to Embod- 
iment 4. Also, the operation of the network adaptive con- 
trol section 28 according to Embodiment 4 is identical 
to that of the network adaptive control section 28 ac- 
cording to Embodiment 2. Therefore, FIG. 9 is a process- 
es ing flowchart explaining the operation of the network 
adaptive control section 28 according to Embodiment 4*. 
[0133] A system including a data adaptation appara- 
tus according to Embodiment 4 will be described below 
using these attached drawings. 

30 [0134] The content data acquisition section 33 of the 
data adaptation section 22 reads and acquires metada- 
ta d101 and data d102 from the storage medium 21. 
Then, the user adaptive control section 24 analyzes the 
acquired metadata d1 01 , extracts the data structure and 

35 at least one segment point of view to be added to each 
segment and the segment priority level at the segment 
point of view, and identifies the data (content) d102 that 
has been read (P1 701 ). Next, the user adaptive control 
section 24 selects the user preference description (for 

*o example, user preference description 131) correspond- 
ing to the identified content from the user preferences 
d1 03 (P1 702). In addition, the user adaptive control sec- 
tion 24 arranges the user points of view (keywords) in- 
cluded in user preference description 131 in the order 

45 in which they are written. In the example in FIG. 12, the 
keywords are arranged in order starting from the key- 
word written in the top line-that is, in the order keyword 
155a, keyword 155b, keyword 155c. Then the first user 
point of view-that is, the one written at the top-is selected 

50 (P1704). The reason for arranging the keywords in the 
order in which they are written in this way is that, since 
user priorities are not assigned to user preferences 
d103 according to Embodiment 4, it is necessary to as- 
sign some kind of priority levels corresponding to user 

55 priorities. In Embodiment 3, the keyword priority levels 
are set in the order in which they are written, as a sub- 
stitute for user priorities. 

[0135] Next, the user adaptive control section 24 
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sends information to the segment selection section 26 
such that a segment that matches that user point of view 
is selected from the data d1 02 : in order from the highest- 
priority user point of view (first user point of view). 
[0136] The segment selection section 26 then com- 5 
pares the first user point of view with the segment points 
of view of the segments, using the information sent from 
the user adaptive control section 24, and judges wheth- 
er there is a segment that has been assigned a segment 
point of view that matches the first user point of view 10 
(P1705). 

[0137] Next, a transition is made to the operation to 
select a segment that has been assigned a segment 
point of view that matches the first user point of view. 
[0138] The segment selection section 26 first provi- is 
sionally selects segments that conform to the user point 
of view (P1 706). Then the segment selection section 26 
judges whether provisional selection has been complet- 
ed for all segments included in the metadata d101 
(P1 707), and if it has not been completed, extracts the 20 
next segment using the metadata d101, and performs 
processing P1705 and P1706. In this way, provisional 
selection can be performed for all the segments includ- 
ed in the data d102. 

[0139] Then, if the data adaptation section 22 judges 25 
in P1 707 that provisional selection has been completed 
for all the segments, the provisionally selected seg- 
ments are arranged in the order of segment priority as- 
signed to the segments (P1708). This is done in order 
to make the actual selection of segments starting from 30 
the segment with the highest segment priority level in 
the actual segment selection process that will be de- 
scribed later. 

[0140] First the data adaptation section 22 performs 
actual selection of the segment with the highest seg- 3s 
ment priority level (P1709). Next, the data adaptation 
section 22 judges whether actual selection has been 
completed for all provisionally selected segments 
(P1710). Then, if the data adaptation section 22 judges 
in P1710 that actual selection has not been completed 40 
for all provisionally selected segments, it judges wheth- 
er the data length of the actually selected segments ex- 
ceeds the restriction conditions of duration or spatial 
range, or both of these (P1711). The data adaptation 
section 22 then repeats the operations from P1709 to 45 
P1711 as long as these restriction conditions are not ex- 
ceeded. 

[0141] If the data adaptation section 22 judges in 
P1710 that actual selection has been completed for all 
provisionally selected segments, it judges whether so 
processing has been performed for all user points of 
view (keywords) (P1 71 5). If the data adaptation section 
22 judges in P 1 71 5 that processing has been completed 
for all user points of view, it terminates processing. If, 
on the other hand, thedata adaptation section 22 judges ss 
in P1 71 5 that processing has not been completed for all 
user points of view, a transition is made to processing 
for the next user point of view. 



[0142] Here, performing processing and selection 
again for segments already selected in the above-de- 
scribed processing would be pointless. Therefore, the 
data adaptation section 22 first extracts unselected seg- 
ments and performs the following processing on the un- 
selected segments only (P1714). The data adaptation 
section 22 then selects the next user point of view 
(P1713) and performs processing P1705 to P1711. 
[0143] The segment selection operation will now be 
described in concrete terms using FIG. 13. First, thedata 
adaptation section 22 looks for a subsegment written in 
the top line-that is with high-priority KWD#1 -within the 
user points of view (user keywords) included in the user 
preferences (user preference description) 131. Key- 
words 631 of subsegment 63 and keywords 661 of sub- 
segment 66 both have KWD#1 . Next, the data adapta- 
tion section 22 adds a duration restriction to subseg- 
ment 63 and subsegment 66, and makes a selection 
from subsegment 63 and subsegment 66 in order of 
stringency of the duration restriction. 
[0144] To be specific, subsegment 66 for which the 
duration restriction is not stringent-that is, duration is 
short-is selected with top priority as output data d102a. 
Then, subsegment 63 is selected as the segment mak- 
ing up output data 102b. 

[0145] Similarly, the data adaptation section 22 looks 
for a subsegment with KWD#2, which has the next-high- 
est priority of the user points of view included in the user 
preferences d1 03. KWD#2 is included in all the subseg- 
ments making up segment 61 . Therefore, it is necessary 
here to decide which subsegment is to be given priority. 
[0146] To be specific, the data adaptation section 22 
compares the segment priority levels of the segment 
points of view added to each subsegment. In the exam- 
ple in FIG. 1 3, subsegment 63, subsegment 62, subseg- 
ment 65, and subsegment 66 have the same priority lev- 
el, followed in priority by subsegment 64 and subseg- 
ment 67. Since subsegment 67 has already been se- 
lected, it is omitted from the items subject to the follow- 
ing processing. 

[0147] Therefore, after the data adaptation section 12 
has selected output data d102b, if further duration re- 
strictions are permitted, subsegment 65, which has a 
higher segment priority level than subsegment 64, is se- 
lected in addition to subsegment 63 as a subsegment 
making up output data 102c. The remaining subseg- 
ment 64 includes KWD#2 and KWD#3, and has a lower 
segment priority level than subsegment 65, so when du- 
ration restrictions are most lenient, subsegment 64 is 
selected in addition to subsegment 63 and subsegment 
65 as a subsegment making up output data stream 
102d. 

[0148] The user adaptive control section 24 updates 
the priority level of a user point of view included in user 
preferences d1 03 that coincides with a keyword accord- 
ing to the priority level of the keyword added to a select- 
ed segment. 

[0149] In this way, it is possible to select segments 
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suitable for user preferences d1 03 from data d1 02, and 
adapt data d102 to user preferences d103. 
[0150] Next, as in Embodiment 1 ; the terminal adap- 
tive control section 25 performs resolution conversion 
of the selected segment sent from the segment selec- 5 
tion section 26 in accordance with the flowchart shown 
in FIG. 7. 

[0151] Next, the operation of the network adaptive 
control section 28 will be described using FIG. 9. FIG. 9 
is a processing flowchart of the network adaptive control 10 
section 28 according to Embodiment 4. • 
[0152] The network adaptive control section 28 ac- 
quires from the network preference acquisition section 
36 network preferences d205 sent from the terminal 2B 
via the network 2A. Then the network adaptive control 15 
section 28 identifies the transmission band of the net- 
work 2A (P901 ). Next, the network adaptive control sec- 
tion 28 determines the segment priority level that the 
segment selected by the segment selection section 26 
has as its own attribute (P902). The network adaptive 20 
control section 28 then judges whether the converted 
data is larger than the transmission band (P903). 
[01 53] If the network adaptive control section 28 judg- 
es in P903 that the converted data is larger than the 
transmission band, the network adaptive control section 25 
28 determines whether to compress all the data, trans- 
mit part of the data, not transmit all the data, or convert 
part of the data before transmitting it (P904). 
[01 54] If, on the otherhand, the network adaptive con- 
trol section 28 judges in P903 that the converted data is 30 
not larger than the transmission band, the network 
adaptive control section 28 judges whether the convert- 
ed segment data is smaller than the transmission band 
(P905). If the network adaptive control section 28 judges 
in P905 that the converted data is smaller than the trans- 35 
mission band, the network adaptive control section 28 
determines whether to perform additional transmission 
of untransmitteddata, not transmit, or transmit after con- 
verting or restoring conversion to its original state 
(P906). 40 
[0155] The data quantity adjustment section 29 then 
adapts the contents of the decision by the network adap- 
tive control section 28 for the actually selected segment, 
adjusts the data quantity, and transmits it to the terminal 
2B. The terminal 2B records the received segment in *5 
the storage medium 2C. 

[01 56] As described above, according to Embodiment 
4, by extracting the data structure and at least one point 
of view to be added to each segment of the structure 
and the segment priority level at the segment point of $o 
view, performing segment selection based on the prior- 
ity of a point of view that coincides with a user point of 
view included in user preferences, performing temporal 
and spatial resolution conversion of selected segments 
according to terminal capability information included in 55 
terminal preferences, and adjusting the selected seg- 
ment data quantity according to the transmission band 
included in network preferences, it is possible to perform 
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data adaptation in a scalable fashion in a form the user 
wishes to receive and in accordance with the status of 
the network. 

[0157] In Embodiment 3 and Embodiment 4, user 
point of view priority levels follow the order of descrip- 
tion, but the priority level of each user point of view may 
also be represented by another description method, 
such as reversing that order, or making an item located 
in the middle of the description order the highest-level 
item. 

[0158] Also, in Embodiment 2 and Embodiment 4, a" 
mode is described whereby a user adaptive control sec- 
tion 24, terminal adaptive control section 25, and net- 
work adaptive control section 28, which are control 
means, are provided on the server 20 side as shown in 
FIG. 8, but a mode is also possible whereby a user adap- 
tive control section 24, terminal adaptive control section 
25, and network adaptive control section 28 are provid- 
ed in a terminal 2B. 

[01 59] In the case of this mode, metadata d1 02 is sent 
from the server 20 to the terminal 2B, data d1 02 is sub- 
jected to user adaptation by the terminal adaptive con- 
trol section 25 in the terminal 2B, and the result is sent 
to the server 20. The server 20 then selects a segment 
from the data dt02 based on information sent from the 
terminal adaptive control section 25, and transmits the 
selected segment to the terminal 2B. A signal that con- 
trols the resolution conversion section 27 of the server 
20 is sent from the terminal adaptive control section 25 
of the terminal 2B, and a signal that controls the data 
quantity adjustment section 29 of the server 20 is sent 
from the network adaptive control section 28 of the ter- 
minal 2B. The resolution conversion section 27 and data 
quantity adjustment section 29 operate in accordance 
with control signals sent from the terminal 2B, and the 
segment selection section 26 processes the selected 
data and sends the processed segment to the storage 
medium 2C of the terminal 2B. 

[0160] Also, in the above-described sample embodi- 
ments, a mode is described whereby one segment point 
of view is assigned to a segment or subsegment. How- 
ever, a mode is also possible whereby, if there is a plu- 
rality of segments or subsegments to which the same 
segment point of view has been assigned, a segment 
point of view is added to one of the segments or sub- 
segments, and link information for that segment point of 
view is assigned to the other segments or subsegments. 
[0161] By this means it is possible to represent the 
segment point of view of a segment or subsegment by 
a link to the segment point of view of another segment 
or subsegment. 

[0162] This mode will be described in detail below us- 
ing FIG.16and FIG. 17. FIG. 1 6 is a drawing showing an- 
other mode of segments according to an embodiment 
of the present invention. FIG.1 7 is a drawing showing 
examples of segment descriptions according to an em- 
bodiment of the present invention. 
[0163] As can be seen from FIG.1 6, segment 1601 is 
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a segment that has the structure already described in 
Embodiment 1 to Embodiment 4. Segment 1601 is as- 
signed a segment point of view and a segment priority 
level. 

[0164] Segment 1602 and segment 1603 are as- 
signed the same segment point of view. Segment 1603 
is assigned link information for segment 1602, and is 
linked to segment 1 602. 

[0165] Segment 1602 and segment 1603 will now be 
described in detail using FIG. 17. 
[0166] Segment 1602 contains a segment point of 
view (keyword) ID number (id) 1701. In this example, 
the ID number 1701 is 1. Segment 1602 also contains 
a segment priority level (P) 1702 corresponding to the 
keyword. In this example, the segment priority level is 
5. Also, "TeamA" is entered as a keyword in segment 
1602. 

[0167] Segment 1603 contains a reference number 
(idref) 1 703 for another segment point of view (keyword) 
which is link information. In this example, the reference 
number 1701 is 1. That is to say, segment 1603 refer- 
ences a keyword whose ID number is 1 . 
[0168] Thus, the keyword of segment 1603 is "Tea- 
mA". Segment 1 603 contains a segment priority level 
(P) 1 704 corresponding to the keyword. In this example, 
the segment priority level is 2. 

[0169] Linking segment keywords in this way makes 
it unnecessary to enter keywords for all segments. In 
addition, linking segment keywords makes explicit the 
relationship between segments. 

(Embodiment 5) 

[01 70] A data adaptation apparatus according to Em- 
bodiment 5 of the present invention will now be de- 
scribed below. The system configuration of Embodiment 
5 is the same as that of Embodiment 1 to Embodiment 4. 
[0171] In Embodiment 5, with regard to segment 
points of view added to segments or subsegments, a 
table summarizing all segment points of view to be reg- 
istered (point of view table) is provided as a content sub- 
element which is an element of the top level of context 
structure description data. 

[0172] Next, the data structure according to Embodi- 
ments will be described using FIG. 18 and FIG. 19. FIG. 
1 8 is a drawing showing the data structure according to 
Embodiments. FIG. 19 is a drawing showing an exam- 
ple of data descriptions according to Embodiment 5. 
[0173] As can be seen from FIG. 18, content has a 
point of view table 1 801 as a sub-element. In the point 
of view table 1801 are stored a plurality of segment 
points of view 1802a to 1802n included in the content. 
[0174] Also, the content includes a plurality of seg- 
ments 1 803 to 1 805. Segment 1 803 is assigned link in- 
formation for the point of view table 1801, and is linked 
to segment point of view 1 802a of the point of view table 
1 801 . Segment 1 804 is assigned link information for the 
point of view table 1 801 , and is linked to segment point 



of view 1 802b of the point of view table 1 801 . Segment 
1804 is assigned link information for the point of view 
table 1 801 . and is linked to segment point of view 1 802c 
of the point of view table 1 801 . Also, segments 1 803 to 
5 1805 are assigned segment priority levels correspond- 
ing to the respective segment points of view. 
[0175] Next, the data structure according to Embodi- 
ment 5 will be described in detail using FIG. 19. 
[0176] The point of view table 1801 contains segment 

10 points of view 1802a to 1802c. Segment point of view 
1 802a contains an ID number (id) 1 901 a. In this exam- 
ple, ID number 1 901 a is 1 . Also, segment point of view 
1802a is indicated by the text "A". 
[0177] Segment point of view 1802b contains an ID 

15 number (id) 1901b. In this example, ID number 1901b 
is 2. Also, segment point of view 1802b is indicated by 
the text "B". Segment point of view 1 802c contains an 
ID number (id) 1901c. In this example, ID number 1 901c 
is 3. Also, segment point of view 1802c is indicated by 

20 the text "C" . 

[0178] Meanwhile, segments 1803 to 1805 contain 
reference numbers (idref) 1 903a to 1 903c, respectively, 
which are link information for segment points of view 
1 802a to 1 802c of the point of view table 1 801 . 

25 [0179] In this example, reference number 1903a of 
segment 1803 is 1 . That is to say, segment 1803 refer- 
ences user point of view 1 802a whose ID number is 1 . 
Therefore, the keyword of segment 1803 is "A". Seg- 
ment 1803 also contains a segment priority level (P) 

30 1904a corresponding to the keyword. In this example, 
the segment priority level is 2. Also, reference number 
1903b of segment 1804 is 2. That is to say, segment 
1804 references user point of view 1802b whose ID 
number is 2. Therefore, the keyword of segment 1804 

35 is "B". 

[0180] Segment 1 804 also contains a segment prior- 
ity level (P) 1 904b corresponding to the keyword, in this 
example, the segment priority level is 3. Also, reference 
number 1 903c of segment 1 805 is 3, That is to say, seg- 

40 ment 1805 references user point of view 1802c whose 
ID number is 3. Therefore, the keyword of segment 1 805 
is "C". Segment 1805 also contains a segment priority 
level (P) 1904c corresponding to the keyword. In this 
example, the segment priority level is 4. 

^5 [0181] Using this kind of configuration makes it easy 
to present a segment point of view list to the user in ad- 
vance. By this means, the user can ascertain the seg- 
ment points of view that appear there before inputting a 
desired segment point of view. Also, segment point of 

so view input by the user can be carried out by making a 
selection from the point of view table. 
[0182] A configuration may also be used whereby a 
pair comprising a link to a corresponding point of view 
in this point of view table and a corresponding score are 

55 added to each segment or subsegment. 

[0183] Also, the point of view table may have a con- 
figuration for provision to a certain segment or subseg- 
ment rather than content, and may use a special de- 
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scription. 

[0184] Moreover, it is also possible to mix pairs of link 
to point of view list and score and pairs of point of view 
and score, rather than representing all cases by a link 
to the point of view list. 

[0185] FIG. 20 is a drawing showing a data configura- 
tion with pairs of point of view and score mixed. As can 
be seen from FIG. 20, segments 1803 and 1804 that 
have link information for the point of view table 1 801 and 
a segment 2001 that does not have link information for 
the point of view table 1801 are mixed in the content. 
[0186] FIG. 21 shows sample descriptions of the data 
configuration shown in FIG. 20. As can be seen from this 
drawing, it is not necessary to enter in the point of view 
table 1 801 all the segment points of view that appear in 
the context contents description data, and only items 
referenced by a link are included. Also, segment 2001 
does not include link information for the point of view 
table 1801. 

(Embodiment 6) 

[01 87] A data adaptation apparatus according to Em- 
bodiment 6 of the present invention will now be de- 
scribed below. 

[01 88] In Embodiment 6, a point of view table showing 
a list of segment points of view that appear in context 
contents description data is provided, and is presented 
to the user before input. 

[0189] The data structure according to Embodiment 
6 will be described using FIG.22. 
[0190] Content according to Embodiment 6 js com- 
posed of a point of view table 2101 and a plurality of 
segments 2103 to 2105. Point of view table 2101 con- 
tains a plurality of segment points of view 2102a to 
2102n. 

[0191] Segment point of view 21 06 and segment pri- 
ority level 2107 are contained in segment 2103, seg- 
ment point of view 21 08 and segment priority level 2109 
in segment 21 04, and segment point of view 2110 and 
segment priority level 2122 in segment 2105. Unlike 
segments in Embodiment 5, segments 21 03 to 21 05 do 
not contain link information for point of view table 2101. 
That is to say, segments 2103 to 2105 and point of view 
table 2101 are configured independently. 
[01 92] FIG. 23 is a drawing showing an example of da- 
ta descriptions according to Embodiment 6 of the 
present invention. As can be seen from FIG. 23, points 
of view 2106, 2108, and 2110 included in segments 
2103 to 2105 are stored in point of view table 2101. To 
be specific, points of view 2301 to 2303 are stored for 
points of view 2106, 2108, and 2110. 
[0193] Then point of view table 21 01 is displayed be- 
fore the user inputs a user point of view. 
[01 94] By this means, the user can ascertain the seg- 
ment points of view that appear there before inputting a 
desired user point of view. Another effect is that user 
point of view input by the user can be carried out by mak- 



ing a selection from the point of view table. 

(Embodiment 7) 

5 [0195] A data adaptation apparatus according to Em- 
bodiment 7 of the present invention will now be de- 
scribed below. 

[0196] In Embodiment 7, when context contents de- 
scription data is to be represented so as to be capable 
10 of being processed by a computer, it is represented di- 
vided into a part that describes the structure and a part 
that describes points of view, which are attributes, and 
their scores. 

[0197] Embodiment 7 will be described below using 
15 FIG.24and FIG.25. FIG .24 is a drawing showing the da- 
ta structure according to Embodiment 7. FIG.25 is a 
drawing showing data descriptions according to Embod- 
iment 7. 

[0198] Shown in the upper half of FIG. 24 is the struc- 
20 ture part 2200a which describes the structure, and 
shown in the lower half is the attribute part 2200b which 
describes the attributes segment points of view and their 
priority levels. The content of structure part 2200a in- 
cludes descriptions of a plurality of segments 2201a to 
25 2201 n. 

[0199] In this drawing, the part describing the struc- 
ture describes the simplest structure, but configurations 
such as described in other embodiments can also be 
handled. 

30 [0200] Also, the attribute part 2200b includes descrip- 
tions of a plurality of segment points of view 2202a and 
2202b. Pairs of link information 2203a to 2203f for the 
target segments and subsegments and priority levels 
2204a to 2204f relating to segment points of view 2202a 

35 and 2202b are assembled for each of segment points 
of view 2202a and 2202b. 

[0201] Next, the data structure according to Embodi- 
ment 7 will be described in detail using FIG.25. 
[0202] As can be seen from FIG.25, the content in- 

40 eludes a plurality of segments 2201 a to 2201c. Segment 
2201a is assigned a segment ID number (id) 2301a. In 
this example, id 2301 a is 1 . Segment 2201 b is assigned 
a segment ID number (id) 2301b. In this example, id 
2301b is 2. Segment 2201 n is assigned a segment ID 

45 number (id) 2301 n. In this example, id 2301 n is n. 

[0203] Meanwhile, it can be seen from FIG.25 that 
segment point of view 2202a is "Team A". Also , segment 
point of view 2202a includes a plurality of segment pri- 
ority levels 2204a to 2204c. In this example, the priority 

50 level of segment priority level 2204a is 3, the priority lev- 
el of segment priority level 2204b is 2, and the priority 
level of segment priority level 2204c is 5. 
[0204] Also, segment priority level 2202a is assigned 
respective link information 2203a to 2203c. As link in- 

55 formation 2203a to 2203c, reference numbers idref for 
referencing ID numbers 2301a to 2301c of segments 
2201 a to 2201c are written. In this example, idref of seg- 
ment priority level 2204a is 1, idref of segment priority 
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level 2204b is n , and idref of segment priority level 2204c 
is 2. Thus, the target segment of segment priority level 
2204a is segment 2201 a f the target segment of seg- 
ment priority level 2204b is segment 2201 c, and the tar- 
get segment of segment priority level 2204c is segment 
2201 n. 

[0205] In this way it is possible to reference segments 
2201a to 2201c from segment priority levels 2204a to 
2204c. 

[0206] Moreover, it can be seen from FIG. 25 that seg- 
ment point of view 2202b is "TeamES". Also ; segment 
point of view 2202b includes a plurality of segment pri- 
ority levels 2204d to 2204f. In this example, the priority 
level of segment priority level 2204d is 4, the priority lev- 
el of segment priority level 2204e is 5, and the priority 
level of segment priority level 2204f is 2. 
[0207] Also, segment priority level 2202b is assigned 
respective link information 2203d to 2203f. As link infor- 
mation 2203d to 2203f, reference numbers idref for ref- 
erencing ID numbers 2301a to 2301c of segments 
2201 a to 2201 c are written. In this example, idref of seg- 
ment priority level 2204d is 2, idref of segment priority 
level 2204e is 3, and idref of segment priority level 2204f 
is 1 . Thus, the target segment of segment priority level 
2204d is segment 2201b, the target segment of seg- 
ment priority level 2204e is segment 2201 c, and the tar- 
get segment of segment priority level 2204f is segment 
2201a 

[0208] In this way it is possible to reference segments 
2201a to 2201 n from segment priority levels 2204a to 
2204f. 

[0209] Segment selection processing in the case of 
this kind of data structure will now be described. First, 
the above-described segment selection section 1 6 or 26 
selects priority levels 2204a to 2204f for each of target 
segment points of view 2202a and 2202b from the parts 
contained in the attribute part 2200b. As selected priority 
levels 2204a to 2204f are assigned link information 
2203a to 2203f respectively, it is possible to select seg- 
ments 2201 a to 2201 n which are the targets of selected 
priority levels 2203a to 2203f. By this means, segment 
selection sections 1 6 and 26 can select target segments 
2201 a to 2201 n by specifying a point of view priority lev- 
el 2204a point of view for each of segments 2202a and 
2202b. 

[0210] The same effect is obtained if the link informa- 
tion 2203a to 2203f and priority level 2204a to 2204f 
parts are written separately rather than in the same file. 
[0211] A mode can also be conceived whereby seg- 
ments and segment points of view are linked in both di- 
rections. 

[0212] This mode will be described below using FIG. 
26 and FIG, 27. FIG. 26 is a drawing showing a data 
structure according to Embodiment 7. FIG. 27 is a draw- 
ing showing data descriptions according to Embodiment 

7. 

[0213] As in Embodiment 7, the data in this mode, al- 
so, is composed of a structure part 2400a and an at- 



34 

tribute part 2400b. The content of the structure part 
2400a includes descriptions of a plurality of segments 
2401a to 2401 n. The attribute part 2400b includes de- 
scriptions of a plurality of segment points of view 2402a 

5 and 2402b. Pairs of link information 2403a to 2403f for 
the target segments and sub-segments and priority lev- 
els 2404a to 2404f relating to segment points of view 
2402a and 2402b are assembled for each of segment 
points of view 2402a and 2402b. 

10 [0214] Also, in this mode, since structure part 2400a 
and attribute part 2400b are linked in both directions, 
link information for segment priority levels 2402a to 
2404f is also included in segment 2401a to segment 
2401 n. 

*5 [0215] Next, the data structure according to this em- 
bodiment will be described in detail using FIG. 27. 
[0216] As can be seen from FIG. 27, the content in- 
cludes a plurality of segments 2401 a to 2401 c. Segment 
2401a is assigned a segment ID number (id) 2501a. In 

20 this example, id 2501 a is 1 . Segment 2401 b is assigned 
a segment ID number (id) 2501b. In this example, id 
2501b is 2, Segment 2401c is assigned a segment ID 
number (id) 2501c. In this example, id 2501c is 3. 
[0217] Meanwhile, segment point of view 2402a in- 

25 eludes a plurality of segment priority levels 2404a to 
2404c. In this example, the priority level of segment pri- 
ority level 2404a is 3, the priority level of segment priority 
level 2404b is 2, and the priority level of segment priority 
level 2404c is 5. 

30 [0218] Also, segment priority level 2402a is assigned 
respective link information 2403a to 2403c. As link in- 
formation 2403a to 2403c, reference numbers idref for 
referencing ID numbers 2501a to 2501c of segments 
2401 a to 2401 c are written. In this example, idref of seg- 

35 ment priority level 2404a is 1 , idref of segment priority 
level 2404b is 2, and idref of segment priority level 2404c 
is n. 

[0219] Thus, the target segment of segment priority 
level 2404a is segment 2401a, the target segment of 
40 segment priority level 2404b is segment 2401 b, and the 
target segment of segment priority level 2404c is seg- 
ment 2401 n. 

[0220] Meanwhile, segment point of view 2402b in- 
cludes a plurality of segment priority levels 2404d to 
45 2404f. In this example, the priority level of segment pri- 
ority level 2404d is 4, the priority level of segment priority 
level 2404e is 5, and the priority level of segment priority 
level 2404f is 2. 

[0221] Also, segment priority level 2402b is assigned 
so respective link information 2403d to 2403f. As link infor- 
mation 2403d to 2403f, reference numbers idref for ref- 
erencing ID numbers 2501a to 2501c of segments 
2401 a to 2401c are written. In this example, idref of seg- 
ment priority level 2404d is 2, idref of segment priority 
55 level 2404e is 3, and idref of segment priority level 2204f 
is 1. 

[0222] Thus, the target segment of segment priority 
level 2404d is segment 2401b, the target segment of 
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segment priority level 2404e is segment 2401c, and the 
target segment of segment priority level 2404f is seg- 
ment 2401 a. 

[0223] Also, segment priority level 2402a is assigned 
respective priority level ID numbers (idref) 2503a to 5 
2503c. In this example, priority level ID number 2503a 
is p1 01, priority level ID number 2503b is p102, and pri- 
ority level ID number 2503c is p103. 
[0224] Moreover, segment priority level 2402b is as- 
signed respective priority level ID numbers (idref) 2503d 10 
to2503f. In this example, priority level ID number 2503d 
is p201 , priority level ID number 2503e is p202, and pri- 
ority level ID number 2503f is p203. 
[0225] Meanwhile segments 2401 a to 2401 n are as- 
signed priority level reference numbers (idrefs) 2502a *s 
to 2502e for referencing priority level ID 2503a to 2503c, 
which are link information for segment priority levels 
2404a to 2404f. In this example, idrefs 2502a is p101, 
idrefs 2502b is p203 : idrefs 2502c is p102, idrefs 2502d 
is p201, and idrefs 2502e is p202. 20 
[0226] Thus, the target segment priority levels of seg- 
ment 2401a are segment priority levels 2404a and 
2404f, the target segment priority levels of segment 
2401 b are segment priority levels 2404c and 2404d, and 
the target segment priority level of segment 2401 n is 25 
segment priority level 2404b. 

[0227] In this way, segments 2401 a to 2401 n and seg- 
ment priority levels 2204a to 2204f can be referenced 
in both directions. As a result, segment selection sec- 
tions 1 6 and 26 can perform processing either using the 30 
method described in Embodiment 1 to Embodiment 6 or 
using the method described in Embodiment 7. 

(Embodiment 8) 

35 

[0228] A data adaptation apparatus according to Em- 
bodiment 8 of the present invention will now be de- 
scribed below. 

[0229] In Embodiment 8, as in Embodiment 7, context 
contents description data representation is divided into *o 
a part that describes the structure and a part that de- 
scribes points of view, which are attributes, and their 
scores. However in Embodiment 8, representation is 
not by means of a pair comprising a link to a segment 
and the segment priority level, but instead items are list- 45 
ed in high-to-low segment priority level order for each 
segment point of view. 

[0230] Embodiment 8 will be described below using 
FIG. 28 and FIG. 29. FIG.28 is a drawing showing the da- 
ta structure according to Embodiment 8. FIG. 29 is a so 
drawing showing data descriptions according to Embod- 
iment 8. 

[0231] As shown in FIG.28, the data structure accord- 
ing to Embodiment 8 is composed of a structure part 
2600a that describes the structure and an attribute part 55 
2600b. The content of structure part 2600a includes de- 
scriptions of a plurality of segments 2601 a to 2601 n. The 
attribute part 2600b includes descriptions of a plurality 



of segment points of view 2602a and 2602b. Link infor- 
mation 2603a to 2603f for the target segment or sub- 
segment is included for each of segment points of view 
2602a and 2602b. 

[0232] Next, the data structure according to Embodi- 
ment 8 will be described in detail using FIG. 29. 
[0233] As can be seen from FIG, 29, the content in- 
cludes a plurality of segments 2601a to 2601 n. Seg- 
ments 2601a to 2601 n are assigned segment ID num- 
bers (id) 2701a to 2701 n, respectively. In this example, 
id 2701a is 1 , id 2701b is 2, and id 2701 n is n. 
[0234] Meanwhile, it can be seen from FIG. 29 that 
segment point of view 2602a is "TeamA". Also, segment 
point of view 2602a is assigned respective link informa- 
tion 2603a to 2603c. As link information 2603a to 2603c, 
reference numbers idref 2702a to 2702c for referencing 
ID numbers 2701a to 2701 n of segments 2601a to 
260 1 n are written . In this example, idref 2702a is 1 , idref 
2702b is n, and idref 2702c is 2. 

[0235] Moreover, as regards link information 2603a to 
2603c, since the description order is recognized as seg- 
ment priority level, in this example the segment priority 
level of link information 2603a is the highest and the seg- 
ment priority level of link information 2603c is the lowest. 
[0236] Thus, the segment priority level of segment 
2601a is the highest and the segment priority level. of 
segment 2601b is the lowest. 

[0237] Meanwhile, it can be seen from FIG. 29 that 
segment point of view 2602b is "TeamB". Also, segment 
point of view 2602b is assigned respective link informa- 
tion 2603d to 2603f . As link information 2603d to 2603f ? 
reference numbers idref 2702d to 2702f for referencing 
ID numbers 2701a to 2701 n of segments 2601a to 
2601 n are written. In this example, idref 2702d is 2, idref 
2702e is 3, and idref 2702f is 1 . 

[0238] Moreover, as regards link information 2603d to 
2603f , since the description order is recognized as seg- 
ment priority level, in this example the segment priority 
level of link information 2603d is the highest and the seg- 
ment priority level of link information 2603f is the lowest. 
[0239] In this way, segments 2201 a to 2201 n can be 
referenced from segment points of view 2602a and 
2602b, and priority levels can be determined, even 
though segment priority levels are not included in seg- 
ment points of view 2602a and 2602b. 
[0240] In FIG.28, there is a different segment priority 
level for each segment (or subsegment), but il is also 
possible to describe items that have the same segment 
priority level, as shown in FIG. 30. 
[0241] In the example shown in FIG. 30, in segment 
point of view 2802 of the attribute part 2800 items ap- 
pear in high-to-low segment priority level order from left 
to right, and items with the same segment priority level 
are written aligned vertically. 

[0242] To be specific, link information 2803a and link 
information 2803b are written aligned vertically, and link 
information 2803a is written to the left of link information 
2803c. Link information 2803a links to segment 2601 b, 
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link information 2803c links to segment 2601 a, and link 
information 2803b links to segment 2601 n. That is to 
say, segment 2601b and segment 2601 n have the same 
segment priority level, and segment 2601 a has a lower 
segment priority level than segment 2601 b and segment 5 
2601n. 

[0243] The data structure in FIG.30 will now be de- 
scribed in detail using FIG. 31. 

[0244] As can be seen from FIG.31, the content in- 
cludes a plurality of segments 2601a to 2601 n. Seg- 10 
ments 2601a to 2601 n are assigned segment ID num- 
bers (id) 2901 a to 2901 n, respectively. In this example, 
id 2901a is 1, id 2901b is 2, and id 2901 n is n. 
[0245] Meanwhile, it can be seen from FIG. 31 that 
segment point of view 2802 is "TeamA". Also, segment 15 
point of view 2602a is assigned respective link informa- 
tion (idref) 2803a to 2803c. In this example, idref 2803a 
is 2, idref 2803b is 1 , and idref 2803c is n. 
[0246] Moreover as regards link information 2803a to 
2803c, since the description order is recognized as seg- 20 
ment priority level ; in this example the segment priority 
level of link information 2803a is the highest and the seg- 
ment priority level of link information 2803c is the lowest. 
[0247] Thus, the segment priority level of segment 
2601a is the highest and the segment priority level of 25 
segment 2601b is the lowest. 

[0248] In this way, it is possible to describe segments 
that have the same segment priority level even though 
segment priority levels are not included in segment 
points of view. 30 
[0249] The above-described segment selection sec- 
tions 16 and 26 perform segment selection using the 
method described in Embodiment 7. 

(Embodiment 9) 35 

[0250] I n Embodiments 1 to 8 of the present invention, 
content identification is performed by means of a con- 
tent identifier However, content identification may also 
be performed by means of a keyword or keyword co- 40 
occurrence probability rather than performing content 
identification by means of a content identifier Moreover, 
content identification may also be performed by means 
of another method. 

[0251] Also, it is possible not to prepare user prefer- 45 
ences for each content item, but to prepare user prefer- 
ences as a number of preference categories or general 
preferences for individual age brackets or groups, etc., 
as defaults unrelated to a user's preferences. 
[0252] In Embodiment 9, content identification is not so 
performed by means of a content identifier. User prefer- 
ences according to Embodiment 9 will be described in 
detail below using FIG. 32 and FIG.33. FIG.32 and FIG. 
33 are drawings showing description definitions of user 
preferences according to Embodiment 9. 55 
[0253] In the drawings, a user preference is indicated 
by UserPreference, a keyword by PreferenceSummary- 
Theme, duration information for displaying content by 



SummaryDuration, and a priority level corresponding to 
a keyword as preferencevalue. 

[0254] As can be seen from the drawings, UserPref- 
erence 3201 is defined as including, as user information 
as elements, Userldentifier 3202, which is an identifier 
for identifying the user, and UsagePreference 3203, 
which is user preference information. Also, UsagePref- 
erence 3203 is defined as including 0 items or 1 item. 
[0255] Next, the definition of Userldentifier 3202 will 
be described. As indicated by reference numeral 3204 
in the drawings, Userldentifier 3202 is defined as not 
including any elements. Also, Userldentifier 3202 is de- 
fined as including protected 3204, which is information 
indicating whether rewriting is possible, and userName 
3205, which is the user name, as attributes. For protect- 
ed 3204, one of the following is selected: "true" meaning 
that rewriting is possible, "false" meaning that rewriting 
is not possible, or "user" meaning that rewriting may be 
possible depending on the user. The default setting for 
protected 3204 is "true". userName 3205 is defined as 
CDATA-that is, text information. By default, userName 

3205 is defined as "anonymous". 

[0256] Next, the definition of UsagePreference 3203 
will be described. As indicated by reference numeral 

3206 in the drawings, UsagePreference 3203 is defined 
as including, as elements, 0 or more BrowsingPrefer- 
ences 3207 that hold information on, for example, con- 
ditions such as time, weather, etc. Also, UsagePrefer- 
ence 3203 is defined as including, as an attribute, allow- 
Automaticupdate 3208, which is information indicating 
whether automatic rewriting by an administrator etc., is 
possible. For allowAutomaticupdate 3208, one of the 
following is selected: "true" meaning that rewriting is 
possible, "false" meaning that rewriting is not possible, 
or "user" meaning that rewriting may be possible de- 
pending on the user. The default setting for allowAuto- 
maticupdate 3208 is "true". 

[0257] Next, the definition of BrowsingPreferences 

3207 will be described. As indicated by reference nu- 
meral 3209 in the drawings, BrowsingPreferences 3207 
is defined as having 0 or more Summarypreferences 
3210 as elements. Also, BrowsingPreferences 3207 is 
defined as including, as elements, protected 3211, 
which is information indicating whether automatic rewrit- 
ing is possible, and preferenceValue 3212, which is the 
priority level of BrowsingPreferences 3207, as at- 
tributes. For protected 3211 , one of the following is se- 
lected: "true" meaning that rewriting is possible, "false" 
meaning that rewriting is not possible, or "user" meaning 
that rewriting may be possible depending on the user. 
The default setting for protected 3211 is "true". prefer- 
enceValue 3212 is defined as CDATA-that is, text infor- 
mation. The default setting for preferenceValue 3212 is 
100. 

[0258] As BrowsingPreferences 3207 has prefer- 
enceValue 3212 in this way, it is possible to perform 
processing with Userpreference 3201 assigned a prior- 
ity level even at a higher level, BrowsingPreferences 
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3207. 

[0259] Next, the definition of Summary Preferences 
3210 will be described. As indicated by reference nu- 
meral 3301 in the drawings. SummaryPreferences 321 0 
is defined as having 0 or more PreferredSummary- 
Theme 3302 items, which are keywords, and 0 or 1 
SummaryDuration 3303, which is display interval infor- 
mation, as elements. 

[0260] Also, SummaryPreferences 321 0 is defined as 
having preferencevalue 3304, which is a priority level, 
as an attribute. 

[0261] The fact that SummaryPreferences 3210 has 
priority level preferencevalue 3304 as an attribute in this 
way makes it possible to perform processing with a pri- 
ority level assigned even in BrowsingPreferences 3207, 
which is at a higher level than keyword PreferredSum- 
maryTheme 3302. 

[0262] Next, the definition of PreferredSummary- 
Theme 3302 will be described. As indicated by refer- 
ence numeral 3305 in the drawings, PreferredSumma- 
ryTheme 3302 is defined as having text data as an ele- 
ment. Also, PreferredSummaryTheme 3302 is defined 
as having, as options, xmhlang 3306, which is language 
information, and preferencevalue 3307, which is priority 
level information, as attributes. The default setting for 
priority level information preferenceV/alue 3307 is 100. 
[0263] The fact that PreferredSummaryTheme 3302 
has priority level information preferenceV/alue 3307 in 
this way makes it possible to process PreferredSumma- 
ryTheme 3302 with a priority level assigned. 
[0264] Also, as indicated by reference numeral 3308 
in the drawings, SummaryDuration 3303 is defined as 
having text data as an element. 

[0265] Thus, with user preferences according to Em- 
bodiment 9, it is possible to perform, not processing for 
particular content, but processing for each higher level: 
BrowsingPreferences 3207, SummaryPreferences 
3210, and PreferredSummaryTheme 3302. Also, prior- 
itized processing is possible for each level above Pre- 
ferredSummaryTheme 3302-that is, BrowsingPrefer- 
ences 3207 and SummaryPreferences 3210. 
[0266] Next, an actual description of user preferences 
according to Embodiment 9 will be described using FIG. 
34. FIG.34 is a drawing showing a sample description 
of user preferences according to Embodiment 9. The 
sample user preference description shown in FIG.34 is 
the sample user preference description shown in FIG. 4 
adapted to Embodiment 9. 

[0267] As indicated by reference numeral 3401 in the 
drawing, for Userldentifier, "true" is entered for protect- 
ed and "Bob" as userName. Also, as indicated by refer- 
ence numeral 3402 in the drawing, for UsagePreferenc- 
es, "false" is entered for allowAutomaticUpdate. And as 
indicated by reference numeral 3403 in the drawing, for 
BrowsingPreferences, "true" is entered for protected. 
[0268] Also, in UserPreference 3400, two Summa- 
ryPreferences 3404a and 3404b are entered. 
[0269] As indicated by reference numeral 3405a in 



the drawing, for SummaryPreferences 3404a, the infor- 
mation "Nakata" is entered as PreferredSummary- 
Theme, preferencevalue of PreferredSummaryTheme 
indicated by reference numeral 3405a in the drawing is 

5 500. As indicated by reference numeral 3406a in the 
drawing, for SummaryPreferences 3404a, the informa- 
tion "Soccer" is entered as PreferredSummaryTheme. 
preferencevalue of PreferredSummaryTheme indicated 
by reference numeral 3406a in the drawing is 400. As 

10 indicated by reference numeral 3407a in the drawing, 
for SummaryPreferences 3404a, the information "Ja- 
pan" is entered as PreferredSummaryTheme. prefer- 
encevalue of PreferredSummaryTheme indicated by 
reference numeral 3407a in the drawing is 200. And as 

'5 indicated by reference numeral 3408a in the drawing, 
"PT5M"-that is, information indicating 5 minutes-is en- 
tered for SummaryDuration. 

[0270] As indicated by reference numeral 3405b in 
the drawing, for SummaryPreferences 3404b, the infor- 

20 mation "Headline" is entered as PreferredSummary- 
Theme. preferenceValue of PreferredSummaryTheme 
indicated by reference numeral 3405b in the drawing is 
500, As indicated by reference numeral 3406b in the 
drawing, for SummaryPreferences 3404b, the informa- 

25 tion "Stock" is entered as PreferredSummaryTheme. 
preferenceValue of PreferredSummaryTheme indicated 
by reference numeral 3406b in the drawing is 500. As 
indicated by reference numeral 3407b in the drawing, 
for SummaryPreferences 3404b, the information 

30 "Sports" is entered as PreferredSummaryTheme. pref- 
erenceValue of PreferredSummaryTheme indicated by 
reference numeral 3407b in the drawing is 300. And as 
indicated by reference numeral 3408b in the drawing, 
"PT3M"-that is, information indicating 3 minutes-is en- 

35 tered for SummaryDuration. 

[0271] As shown above, a description with contents 
corresponding to FIG. 4 can also be achieved by means 
of user preference definitions according to Embodiment 
9. 

40 [0272] Next, segment descriptions according to Em- 
bodiment 9 will be described. First, segment definitions 
according to Embodiment 9 will be described using FIG. 
35 to FIG.37. FIG. 35 to FIG. 37 are drawings showing 
segment description definitions according to Embodi- 

^5 ment 9. 

[0273] In this example, the definition of AudioVis- 
ualSegment, an audio and visual segment, will be de- 
scribed. 

[0274] As indicated by reference numeral 3501 in the 
so drawings, AudioVisuaJSegment 3502 is defined as in- 
cluding 0 or more PointofView 3503 and MediaTime 
3504 items as elements. PointofView 3503 is an ele- 
ment that includes a point of view relating to the seg- 
ment. MediaTime 3504 is an element that includes the 
55 segment duration, etc. 

[0275] Also, as indicated by reference numeral 3505 
in the drawings, AudioVisualSegment 3502 is defined 
as having an identifier ID as an attribute. Moreover, Au- 
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dioVisualSegrnent 3502 is defined as having, as at- 
tributes, URL reference information href as an option as 
indicated by reference numeral 3506 in the drawings, 
and ID reference information idref as an option as indi- 
cated by reference numeral 3507 in the drawings. 
[0276] Next, the definition of Pointofview 3503 will be 
described. As indicated by reference numeral 3508 in 
the drawings, Pointofview 3503 is defined as having, as 
elements, 0 or 1 Supplemental Info 3509 item and 1 or 
more Value 3510 items. Supplementallnfo 3509 is a 
comment indicating the contents of PointofView 3503. 
Value 3510 is priority level information for PointofView 
3503. 

[0277] As indicated by reference numeral 3511 in the 
drawings, PointofView 3503 is defined as having iden- 
tifier information id as an option in its attributes. Also, as 
indicated by reference numeral 3512 in the drawings, 
PointofView 3503 is defined as having segment view- 
point viewpoint as an attribute. And viewpoint is defined 
as being written as text information. 
[0278] Next, the definition of Value 3510 will be de- 
scribed. As indicated by reference numeral 3513 in the 
drawings, Value 3510 is defined as including text infor- 
mation as an element. Also, as indicated by reference 
numeral 351 4 in the drawings, Value 351 0 is defined as 
having an identifier id as an attribute. Identifier id of Val- 
ue 3510 is defined as being an option. 
[0279] The fact that PointofView 3503 and Value 351 0 
have id, and AudioVisualSegment 3502 has idref that 
references these id's makes it possible for AudioVis- 
ualSegment 3502 to reference PointofView 3503 and 
Value 351 0 by means of idref. That is to say, AudioVis- 
ualSegment 3502 can link to PointofView 3503 and Val- 
ue 351 0 by means of idref. 

[0280] Next, the definition of Supplementallnfo 3509 
will be described. As indicated by reference numeral 
3601 in the drawings, Supplementallnfo 3509 is defined 
as having at least one FreeTextAnnotation 3602 or 
Structured An notation 3603 as an element. 
[0281] Also, as indicated by reference numeral 3604 
in the drawings, Supplementallnfo 3509 is defined as 
having text data as an element. And, as indicated by 
reference numeral 3605 in the drawings, Supplementa- 
llnfo 3509 is defined as having language information as 
an attribute. 

[0282] Next, the definition of StructuredAnnotation 
3603 will be described. As indicated by reference nu- 
meral 3606 in the drawings, StructuredAnnotation 3603 
is defined as having, as elements, 0 or 1 Who 3607 item, 
which is information indicating who performed an action, 
or 0 or 1 WhatObject 3608 item, which is information 
indicating the object of an action, or 0 or 1 WhatAction 
3609 item, which is information indicating what was 
done, or 0 or 1 Where 3610 item, which is information 
indicating where an action was performed, or 0 or 1 
When 3611 item, which is information indicating when 
an action was performed, orO or 1 Why 3612 item, which 
is information indicating why an action was performed. 



[0283] As indicated by reference numerals 3613 to 
3618 in the drawings, Who 3607 : WhatObject 3608, 
WhatAction 3609 ; Where 3610, When 361 1 f and Why 
3612 are defined as including text information as ele- 
5 ments. 

[0284] Also, as indicated by reference numeral 3619 
in the drawings, StructuredAnnotation 3603 is defined 
as having identifier information id as an attribute. And, 
as indicated by reference numeral 3620 in the drawings, 

10 StructuredAnnotation 3603 is defined as having lan- 
guage information as an attribute. 
[0285] In this way, it is easy to identify what kind of 
information AudioVisualSegment 3502 is by means of 
StructuredAnnotation 3603. 

15 [0286] Next, the definition of MediaTime 3504 will be 
described. As indicated by reference numeral 3701 in 
the drawings, MediaTime 3504 is defined as having Me- 
diaTimePoint 3702 and MediaDuration 3703 as ele- 
ments. MediaTime Point 3702 is AudioVisualSegment 

20 3502 start time information and MediaDuration 3703 is 
AudioVisualSegment 3502 duration information. 
[0287] Also, as indicated by reference numeral 3704 
in the drawings, MediaTimePoint 3702 is defined as 
having text information as an element. And, as indicated 

25 by reference numeral 3705 in the drawings, MediaDu- 
ration 3703 is defined as having text information as an 
element. 

[0288] AudioVisualSegment 3502 is defined as de- 
scribed above. Next, a sample description of AudioVis- 
30 ualSegment 3502 defined as shown above will be de- 
scribed. 

[0289] FIG.38 is a drawing showing a sample descrip- 
tion that adapts the segment sample description shown 
in FIG.17to Embodiment 9. 

35 [0290] As can be seen from FIG.38, segment 1602 
contains a segment point of view (keyword) ID number 
(id) 1701, as in the sample description in FIG. 17. Seg- 
ment 1602 also contains a segment priority level (P) 
1702 corresponding to the keyword. Also, "TeamA" is 

40 entered as a keyword in segment 1602. 

[0291] Segment 1603 contains a reference number 
(idref) 1 703 for another segment point of view (keyword) 
which is link information, as in the sample description in 
FIG.1 7. Thus, the keyword of segment 1 603 is "TeamA". 

^5 Segment 1 603 also contains a segment priority level (P) 
1704 corresponding to the keyword. 
[0292] In this way, it is possible to link segments by 
means of Embodiment 9 also. 

[0293] Next, the segment sample description shown 
so in FIG. 19 adapted to Embodiment 9 will be described 
using FIG. 39. 

[0294] As can be seen from FIG. 39, the point of view 
table 1801 contains segment points of view 1802a to 
1802c. Segment point of view 1802a contains an ID 
55 number (id) 1901a. Also, segment point of view 1802a 
is indicated by the text "A". 

[0295] Segment point of view 1 802b contains an ID 
number (id) 1901b. Also, segment point of view 1802b 
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is indicated by the text "8". Segment point of view 1 802c 
contains an ID number (id) 1 901 c. Also, segment point 
of view 1802c is indicated by the text "C". 
[0296] Meanwhile, segments 1803 to 1805 contain 
reference numbers (idref) 1 903a to 1 903c, respectively, 
which are link information for segment points of view 
1 802a to 1 802c of the point of view table 1 801 . 
[0297] Segment 1 803 contains a segment priority lev- 
el (P) 1904a corresponding to the keyword. Segment 
1 804 contains a segment priority level (P) 1 904b corre- 
sponding to the keyword. Segment 1 805 contains a seg- 
ment priority level (P) 1904c corresponding to the key- 
word. 

[0298] In this way, it is easy to present a segment point 
of view list to the user in advance using Embodiment 9 
also. 

[0299] Next, the segment sample description shown 
in FIG.21 adapted to Embodiment 9 will be described 
using FIG. 40. 

[0300] As can be seen from FIG.40, in the point of 
view table 1801 it is not necessary to enter all the seg- 
ment points of view that appear in the context contents 
description data, and only items referenced by a link are 
included. Also, segment 2001 does not include link in- 
formation for the point of view table 1 801 . 
[0301] Thus, it is possible to adapt the description in 
FIG. 21 to Embodiment 9 by means of the kind of de- 
scription shown in FIG. 40. 

[0302] Next, the segment sample description shown 
in FIG.23 adapted to Embodiment 9 will be described 
using FIG. 41 . 

[0303] As can be seen from FIG.41, points of view 
2106, 2108, and 2110 included in segments 2103 to 
21 05 are stored in point of view table 21 01 . To be spe- 
cific, points of view 2301 to 2303 are stored for points 
of view 21 06, 2108, and 2110. 

Then point of view table 2101 is displayed before the 
user inputs a user point of view. Thus, it is possible to 
adapt the description in FIG.23 to Embodiment 9 by 
means of the kind of description shown in FIG.41 . 
[0304] Next, the segment sample description shown 
in FIG.25 adapted to Embodiment 9 will be described 
using FIG. 42. 

[0305] As can be seen from FIG.42, the content in- 
cludes a plurality of segments 2201 a to 2201 c. Segment 
2201a is assigned a segment ID number (id) 2301a. 
Segment 2201b is assigned a segment ID number (id) 
2301b. Segment 2201c is assigned a segment ID 
number (id) 2301c. 

[0306] Meanwhile, it can be seen that segment point 
of view 2202a is TeamA". Also, segment point of view 
2202a includes a plurality of segment priority levels 
2204a to 2204c. 

[0307] In addition, segment priority level 2202a is as- 
signed respective link information 2203a to 2203c. As 
link information 2203a to 2203c, reference numbers id- 
ref for referencing ID numbers 2301a to 2301c of seg- 
ments 2201 a to 2201 c are written. 



[0308] In this way it is possible to reference segments 
2201a to 2201c from segment priority levels 2204a to 
2204c. 

[0309] Moreover, it can be seen that segment point of 
5 view 2202b is "TeamB". Also, segment point of view 
2202b includes a plurality of segment priority levels 
2204d to 2204f. 

[0310] In addition, segment priority level 2202b is as- 
signed respective link information 2203d to 2203f. As 
10 Jink information 2203d to 2203f , reference numbers idref 
for referencing ID numbers 2301 a to 2301c of segments 
2201 a to 2201 c are written. 

[031 1 ] In this way it is possible to reference segments 
2201a to 2201 n from segment priority levels 2204a to 
>5 2204f. 

[0312] Thus, it is possible to adapt the description in 
FIG.25 to Embodiment 9 by means of the kind of de- 
scription shown in FIG.42. 

[0313] Next, the segment sample description shown 
20 in FIG. 27 adapted to Embodiment 9 will be described 
using FIG.43 and FiG.44. 

[031 4] As can be seen from the drawings, the content 
includes a plurality of segments 2401a to 2401c. Seg- 
ment 2401a is assigned a segment ID number (id) 
25 2501a. Segment 2401b is assigned a segment -ID 
number (id) 2501b. Segment 2401c is assigned a seg- 
ment ID number (id) 2501c. 

[0315] Meanwhile, segment point of view 2402a Jn- 
cludes a plurality of segment priority levels 2404a to 
30 2404c. 

[0316] Also, segment priority level 2402a is assigned 
respective link information 2403a to 2403c. As link in- 
formation 2403a to 2403c, reference numbers idref for 
referencing ID numbers 2501a to 2501c of segments 

35 2401a to 2401c are written. 

[0317] Thus, the target segment of segment priority 
level 2404a is segment 2401a, the target segment of 
segment priority level 2404b is segment 2401 b, and the 
target segment of segment priority level 2404c is seg- 

40 ment2401n. 

[0318] Meanwhile, segment point of view 2402b in- 
cludes a plurality of segment priority levels 2404d to 
2404f . Also, segment priority level 2402b is assigned re- 
spective link information 2403d to 2403f. As link infor- 

^5 mation 2203d to 2403f , reference numbers idref for ref- 
erencing ID numbers 2501a to 2501c of segments 
2401 a to 2401 c are written. 

[0319] Thus, the target segment of segment priority 
level 2404d is segment 2401b, the target segment of 
so segment priority level 2404e is segment 2401c, and the 
target segment of segment priority level 2404f is seg- 
ment 2401a. 

[0320] Also, segment priority level 2402a is assigned 
respective priority level ID numbers (idref) 2503a to 
55 2503c, and segment priority level 2402b is assigned re- 
spective priority level ID numbers (idref) 2503d to 2503f . 
[0321] Meanwhile segments 2401a to 2401c are as- 
signed priority level reference numbers (idrefs) 2502a 
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to 2502e for referencing priority level ID 2503a to 2503c, 
which are link information for segment priority levels 
2404a to 2404f. 

[0322] Thus, the target segment priority levels of seg- 
ment 2401a are segment priority levels 2404a and 5 
2404f, the target segment priority levels of segment 
2401 b are segment priority levels 2404b and 2404d, and 
the target segment priority level of segment 2401c is 
segment priority level 2404e. 

[0323] In this way, segments 2401 a to 2401 c and seg- w 
ment priority levels 2204a to 2204f can be referenced 
in both directions using Embodiment 9 also. 
[0324] Next, the segment sample description shown 
in FIG.29 adapted to Embodiment 9 will be described 
using FIG. 45. is 
[0325] As can be seen from the drawing, the content 
includes a plurality of segments 2601a to 2601c. Seg- 
ments 2601a to 2601c are assigned segment ID num- 
bers (id) 2701a to 2701c, respectively. 

[0326] Meanwhile, it can be seen from the drawing 20 
that segment point of view 2602a is "TeamA". Also, seg- 
ment point of view 2602a is assigned respective link in- 
formation 2603a to 2603c. As link information 2603a to 
2603c, reference numbers idref 2702a to 2702c for ref- 
erencing ID numbers 2701a to 2701 n of segments 25 
2601 a to 2601 n are written, 

[0327] Moreover, as regards link information 2603a to 
2603c, since the description order is recognized as seg- 
ment priority level, in this example the segment priority 
level of link information 2603a is the highest and the seg- 30 
ment priority level of linkinformation 2603c is the lowest. 
[0328] Thus, the segment priority level of segment 
2601a is the highest and the segment priority level of 
segment 2601b is the lowest. 

[0329] Meanwhile, it can be seen from the drawing 35 
that segment point of view 2602b is "TeamB". Also, seg- 
ment point of view 2602b is assigned respective link in- 
formation 2603d to 2603f. As link information 2603d to 
2603f, reference numbers idref 2702d to 2702f for ref- 
erencing ID numbers 2701a to 2701c of segments 40 
2601a to 2601c are written. 

[0330] Moreover, as regards link information 2603d to 
2603f, since the description order is recognized as seg- 
ment priority level, in this example the segment priority 
level of link information 2603d is the highest and the seg- -*5 
ment priority level of link information 2603f is the lowest. 
[0331] Thus, the segment priority level of segment 
2601b is the highest and the segment priority level of 
segment 2601a is the lowest. 

[0332] Thus, it is possible to adapt the description in so 
FIG.29 to Embodiment 9 by means of the description 
shown in FIG. 45. 

[0333] Next, the segment sample description shown 
in FIG. 31 adapted to Embodiment 9 will be described 
using FIG.46. 55 
[0334] As can be seen from the drawing, the content 
includes a plurality of segments 2601a to 2601c. Seg- 
ments 2601a to 2601c are assigned segment ID num- 



bers (id) 2901a to 2901c, respectively 
[0335] Meanwhile, it can be seen from the drawing 
that segment point of view 2802 is "TeamA". Also, seg- 
ment point of view 2602a is assigned respective link in- 
formation (idref) 2803a to 2803c. 
[0336] Moreover, as regards link information 2803a to 
2803c, since the description order is recognized as seg- 
ment priority level, in this example the segment priority 
level of link information 2803a is the highest and theseg- 
ment priority level of link information 2803c is the lowest. 
[0337] Thus, the segment priority level of segment 
2601a is the highest and the segment priority level of 
segment 2601b is the lowest. 

[0338] Thus, it is possible to adapt the description in 
FIG. 31 to Embodiment 9 using the description shown in 
FIG.46. 

(Embodiment 10) 

[0339] In Embodiment 1 to Embodiment 9, user pref- 
erences have been described in a mode whereby they 
are written in XML-DTD, but user preferences may also 
be written in RDF, XML-Schema, or other XML-based 
languages, or a non-XML language, or using non-lan- 
guage descriptions. 

[0340] In Embodiment 1 0, user preferences are writ- 
ten in XML-Schema. User preference definitions ac- 
cording to Embodiment 1 0 will be described below using 
FIG.47to FIG.51. FIG. 47 to FIG.51 are drawings show- 
ing user preference description definitions according to 
Embodiment 10. Also, FIG. 47 to FIG.51 correspond to 
user preference description definitions according to Em- 
bodiment 9. 

[0341] As can be seen from the drawings, UserPref- 
erence 3201 is defined as including, as user information 
as elements, Useridentifier 3202, which is an identifier 
for identifying the user, and UsagePreference 3203, 
which is user preference information. Also, UsagePref- 
erence 3203 is defined as including 0 items or 1 item. 
[0342] Next, the definition of UsagePreference 3203 
will be described. As indicated by reference numeral 
4803 in the drawings, UsagePreference 3203 is defined 
as including 0 ormore BrowsingPreferences 3207. Also, 
UsagePreference 3203 is defined as including allowAu- 
tomaticUpdate 3208 as an attribute. In addition, as indi- 
cated by reference numeral 4801 in the drawings. Us- 
agePreference 3203 is defined as including 0 or more 
FilteringAndSearchPreferences 4802 as elements. 
[0343] Next, the definition of BrowsingPreferences 
3207 will be described. As indicated by reference nu- 
meral 4900 in the drawings, BrowsingPreferences 3207 
is defined as having 0 or more Summarypreferences 
3210 as elements. Also, BrowsingPreferences 3207 is 
defined as including protected 3211 and p reference Val- 
ue 3212 as attributes. In addition, BrowsingPreferences 
3207 is defined as including 0 or more PreferenceCon- 
ditionType 4902 items as elements. 
[0344] Next, the definition of SummaryPreferences 
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3210 will be described. As indicated by reference nu- 
meral 5002 in the drawings, SummaryPreferences 321 0 
is defined as having 0 or more elements called Summa- 
ryPreferencesType as an extension of summaryCom- 
ponentType, which holds a list of the kind indicated by 
reference numeral 5003 in the drawings. Also, Summa- 
ryPreferences 321 0 is defined as having 0 or more Pre- 
ferredSummary Theme 3302 items, which are key- 
words, and 0 or 1 SummaryDuration 3303 : which is dis- 
play interval information, as elements. 
[0345] In addition, SummaryPreferences 3210 is de- 
fined as having preferencevalue 3304, which is a priority 
level, as an attribute. The default value of preference- 
value 3304 is defined as being 100. 
[0346] Also, P referred Su mm aryTh erne 3302 is de- 
fined as having text data and language information as 
TextualType-that is, elements. In addition, Preferred- 
SummaryTheme 3302 is defined as having priority level 
information preferencevalue 3307 as an attribute. 
[0347] Moreover, as indicated by reference numerals 
5101 to 5110 in the drawings, SummaryPreferences 
3210 is defined as having, as elements, MinSummary- 
Duration indicating the minimum duration, MaxSumma- 
ryDuration indicating the maximum duration, Nu- 
mOfKeyFrames indicating the number of display 
frames, MinNumOf Key Frames indicating the minimum 
number of display frames, MaxNumOf Key Frames indi- 
cating the maximum number of display frames, NumOf- 
Chars indicating the number of display characters, Min- 
NumOfChars indicating the minimum number of display 
characters, and MaxNumOfChars indicating the maxi- 
mum number of display characters. 
[0348] As indicated by reference numeral 511 0 in the 
drawings, these elements are defined as having a pri- 
ority level as an attribute. 

[0349] Thus, user preferences can be described us- 
ing XML-Schema, using FIG. 47 to FIG.51. 
[0350] Next, an actual example of user preference de- 
scription definitions according to Embodiment 10 will be 
described using FIG. 52. FIG. 52 is a drawing showing a 
sample user preference description according to Em- 
bodiment 10. 

[0351] As indicated by reference numeral 5201 in the 
drawing, for Userldentifier, "true" is entered for protect- 
ed and "Mike" as userName. Also, as indicated by ref- 
erence numeral 5202 in the drawing, for UsagePrefer- 
ences, "false" is entered for allowAutomaticUpdate. And 
as indicated by reference numeral 5203 in the drawing, 
forBrowsingPreferences, "true" is entered for protected. 
[0352] Also, in UserPreference 5200, two Summa- 
ryPreferences 5204 are entered. 

[0353] As indicated by reference numeral 5205 in the 
drawing, for SummaryPreferences 5204, the informa- 
tion "Free-kick" is entered as PreferredSummary- 
Theme. Also, as indicated by reference numeral 5206 
in the drawing, for SummaryPreferences 5204, the in- 
formation "Goals" is entered as PreferredSummary- 
Theme. And as indicated by reference numeral 5208 in 



the drawing, "PT5M M -that is, information indicating 5 
minutes-is entered for SummaryDuration. 
[0354] In this way user preferences can be described 
using XML-Schema. 

5 [0355] In Embodiment 10, segment descriptions are 
also written using XML-Schema. Segment descriptions 
according to Embodiment 10 will be described below. 
First, segment definitions according to Embodiment 10 
will be described using FIG.53 to FIG.56. FIG. 53 to FIG. 

10 56 are drawings showing segment description defini- 
tions according to Embodiment 10. 
[0356] A segment according to Embodiment 1 0 is de- 
fined as Segment DS, an abstract segment, shown in 
FIG.53 and FIG. 54. AudioVisualSegment DS, Audi- 
's oSegmentDS, VideoSegment DS, StillRegion DS, and 
MovingRegion DS, respectively, are concrete descrip- 
tion definitions succeeding Segment DS. AudioVis- 
ualSegment DS will be described below, but first Seg- 
ment DS will be described. 

20 [0357] As indicated by reference numeral 5300 in the 
drawings, Segment is declared as abstract type. 
[0358] As indicated by reference numeral 5301 in the 
drawings, Segment is defined as having Medialnforma- 
tion, which is media information on the coding format, 

25 etc., as an element. Also, as indicated by reference nu- 
meral 5302 in the drawings, Segment is defined as hav- 
ing MediaLocator, which is link information for the actual 
body of this segment, as an element. In addition, as in- 
dicated by reference numeral 5303 in the drawings, 

30 Segment is defined as having Createlnformation, which 
is manufacturer information such as copyright informa- 
tion, as an element. Moreover, as indicated by reference 
numeral 5304 in the drawings, Segment is defined as 
having Usagelnformation, which is usage information 

35 such as usage limitations, as an element. Also, as indi- 
cated by reference numeral 5305 in the drawings, Seg- 
ment is defined as having TextAnnotation, which is seg- 
ment annotation, as an element. Also, as indicated by 
reference numeral 5307 in the drawings, Segment is de- 

40 fined as having PointOfView, which is segment annota- 
tion, as an element. In addition, as indicated by refer- 
ence numeral 5307 in the drawings. Segment is defined 
as having TextAnnotation, which is a segment point of 
view (keyword), as an element. And, as indicated by ref- 

4 5 erence numeral 5308 in the drawings, Segment is de- 
fined as having SegmentDecomposition, which is used 
for specifying subsegments, as an element. 
[0359] Also, as indicated by reference numeral 5311 
in the drawings, Segment is defined as having an iden- 

50 tifier id as an attribute. In addition, as indicated by ref- 
erence numeral 5312 in the drawings, Segment is de- 
fined as having URL link information href as an attribute. 
And. as indicated by reference numeral 5313 in the 
drawings, Segment is defined as having id link informa- 

55 tion idref as an attribute. 

[0360] Thus, Segment has keyword information Poin- 
tofView, an identifier id, and idref, which is reference in- 
formation for other segment identifiers. 
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[0361] Next, the aforementioned AudioVisualSeg- 
ment succeeding the abstract segment will be described 
using FIG. 55. 

[0362] As indicated by reference numeral 5501 in the 
drawing, AudioVisualSegment extends the above-de- 
scribed abstract segment. 

[0363] Also, as indicated by reference numeral 5502 
in the drawing, AudioVisualSegment is defined as hav- 
ing MediaTime, which indicates the start time, as an ex- 
tended element. 

[0364] Moreover, as indicated by reference numeral 
5504 in the drawing, AudioVisualSegment is defined as 
having idref, which is reference information for another 
segment, as an attribute. 

[0365] Thus, AudioVisualSegment has reference in- 
formation idref in the same way as Embodiment 9. 
[0366] Next, the definition of PointofView will be de- 
scribed using FIG.56. The type of PointofView is de- 
clared as indicated by reference numeral 5600 in the 
drawing. 

[0367] As indicated by reference numeral 5601 in the 
drawing, Pointofview is defined as having Supplemen- 
tailnfo as an element. Also, as indicated by reference 
numeral 5602 in the drawing, PointofView is defined as 
having Value as an element. 

[0368] The type of Value is PrimitivelmportanceType 
shown by reference numeral 5603 in the drawing. As 
indicated by reference numeral 5604 in the drawing, 
PrimitivelmportanceType is defined as having segment 
id reference information idref as an attribute. 
[0369] Also, as indicated by reference numeral 5606 
in the drawing, PointofView is defined as having seg- 
ment viewpoint viewpoint, written as text, as an attribute. 
[0370] Thus, PointofView has id and idref in the same 
way as Embodiment 9. 

[0371] Next, a sample segment description based on 
the above-described definitions will be described using 
FIG. 57 to FIG.59. FIG. 57 to FIG. 59 are drawings show- 
ing a sample segment description according to Embod- 
iment 10. 

[0372] The sample description shown in FIG. 57 to 
FIG.59 is an example in which PointofView is written 
within the segment structure. 

[0373] In this example, as indicated by reference nu- 
meral 5700 in the drawings, id has a segment called 
"FootBallGame". As indicated by reference numerals 
5701 a and 5701 b in the drawings, the segment that has 
this "FootBallGame" id is composed of two subseg- 
ments. Also the subsegment indicated by reference nu- 
meral 5701a in the drawings has a subsegment 5702a 
for which id is "segl " a subsegment 5702b for which id 
is "seg2", and a subsegment 5702c for which id is 
M seg20". • 

[0374] Subsegment 5702a has a viewPoint "TeamA" 
for which priority level Value is 0.3, as indicated by ref- 
erence numeral 5703a in the drawings, and a viewpoint 
"TeamB" for which priority level Value is 0.7, as indicated 
by reference numeral 5703b in the drawings. In addition, 



subsegment 5702a also has MediaTime information as 
indicated by reference numeral 5704a in the drawings. 
[0375] Subsegment 5702b has a viewpoint "TeamA" 
for which priority level Value is 0.5, as indicated by ref- 

5 erence numeral 5703c in the drawings. In addition, sub- 
segment 5702a also has MediaTime information as in- 
dicated by reference numeral 5704b in the drawings. 
[0376] Subsegment 5702c has a viewpoint 'TeamA" 
for which priority level Value is 0.8, as indicated by ref- 

10 erence numeral 5703d in the drawings, and a viewpoint 
"TeamB" for which priority level Value is 0.2, as indicated 
by reference numeral 5703e in the drawings. In addition, 
subsegment 5702a also has MediaTime information as 
indicated by reference numeral 5704c in the drawings. 

15 [0377] Meanwhile, the subsegment indicated by ref- 
erence numeral 5701b in the drawings has a subseg- 
ment 5702d for which id is "2seg1 " a subsegment 5702e 
for which id is "2seg2", and a subsegment 5702f for 
which id is "2seg20". Subsegment 5702d has a view- 

20 point "TeamA" for which priority level Value is 0.3, as 
indicated by reference numeral 5703f in the drawings. 
In addition, subsegment 5702b also has MediaTime in- 
formation as indicated by reference numeral 5704d in 
the drawings. 

25 [0378] Subsegment 5702b has a viewpoint "TeamA" 
for which priority level Value is 0.5, as indicated by ref- 
erence numeral 5703g in the drawings. In addition, sub- 
segment 5702a also has MediaTime information as in- 
dicated by reference numeral 5704e in the drawings. 

30 [0379] Subsegment 5702f has a viewpoint "TeamA" 
for which priority level Value is 0.8, as indicated by ref- 
erence numeral 5703h in the drawings. In addition, sub- 
segment 5702f also has MediaTime information as indi- 
cated by reference numeral 5704f in the drawings. 

35 [0380] In this way, in the sample description shown in 
FIG.57 to FIG.59, PointofView is written within the seg- 
ment structure. 

[0381] Next, a sample description that separates the 
segment structure and PointofView structure will be de- 

40 scribed using FIG.60 and FIG. 61. FIG. 60 and FIG. 61 
are drawings showing another example of a segment 
description according to Embodiment 10. 
[0382] In this example, as indicated by reference nu- 
meral 6000 in the drawings, id has a segment structure 

^5 called "FootBallGame" and PointofView structures 
6005 and 6008. As indicated by reference numeral 6001 
in the drawings, the segment structure that has this 
"FootBallGame" id is composed of one subsegment. Al- 
so the subsegment indicated by reference numeral 

so 6001 in the drawings has a subsegment 6004a for which 
id is M seg1 " , a subsegment 6004b for which id is "seg2", 
and a subsegment 6004c for which id is "seg20", 
[0383] Subsegment 6002a has MediaTime informa- 
tion as indicated by reference numeral 6004a in the 

55 drawings. Subsegment 6002b has MediaTime informa- 
tion as indicated by reference numeral 6004b in the 
drawings. Subsegment 6002c has MediaTime informa- 
tion as indicated by reference numeral 6004c in the 
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drawings. 

[0384] Subsegment 6001 , also, has MediaTime infor- 
mation, as indicated by reference numeral 6004d in the 
drawings. 

[0385] Meanwhile, PointOfView structure 6005 has a 
PointOfView "TeamA , \ Also, PointOfView structure 
6005 has segment reference information 6006a to 
6006c, Segment reference information 6006a has 0.3 
as Value, and its segment reference information idref is 
"segl" Segment reference information 6006b has 0.5 
as Value, and its segment reference information idref is 
"seg2". Segment reference information 6006c has 0.8 
as Value, and its segment reference information idref is 
"seg20". 

[0386] PointOfView structure 6008 has a PointOfView 
"TeamB". Also, PointOfView structure 6008 has seg- 
ment reference information 6009a and 6009b. Segment 
reference information 6009a has 0.7 as Value, and its 
segment reference information idref is "segl" Segment 
reference information 6009b has 0.2 as Value, and its 
segment reference information idref is "seg20". 
[0387] Thus, since PointOfView has information that 
references the segment id in Embodiment 10, also, it is 
possible to separate the segment structure and Poin- 
tOfView structure. 

(Embodiment 11 ) 

[0388] ~* In the above-described embodiments, a point 
of view (keyword) is assigned to a segment, and seg- 
ment extraction is performed using that point of view. 
Then, a plurality of segments extracted in this way are 
grouped together, and a digest is created. 
[0389] In Embodiment 11, a point of view (keyword) 
is assigned to this digest. By this means, it is possible 
to perform digest extraction using a point of view. 
[0390] Adigest according to Embodiment 11 will be 
described below using FIG. 62 to FIG.65. First, the def- 
inition of a digest (shown as HierarchicalSummary in the 
drawings) will be described using FIG. 62 and FIG. 63. 
[0391] The-type of HierarchicalSummary is declared 
as indicated by reference numeral 6200 in the drawings. 
Also, as indicated by reference numeral 6201 in the 
drawings, HierarchicalSummary is defined as having 
SummaryThemeList, which is a list of points of view 
(keywords), as an element. Moreover, as indicated by 
reference numeral 6202 in the drawings, Hierarchical- 
Summary is defined as having HighlightLevel, which is 
information indicating what kind of segment configura- 
tion HierarchicalSummary has, as an element. 
[0392] Also, as indicated by reference numeral 6203 
in the drawings, HierarchicalSummary is defined as 
having summaryComponentList as an attribute, sum- 
maryComponentList succeeds summaryCornpo- 
nentListType indicating what kind of configuration Hier- 
archicalSummary has. To be specific, summaryCornpo- 
nentListType has a configuration comprising key- 
Frames indicating the frame configuration as a list, ke- 



yVideoClips indicating the video clip configuration, 
keyAudioClips indicating the audio clip configuration, 
key Themes indicating the theme configuration, and un- 
constrained indicating restriction conditions. 
5 [0393] Next, the definition of SummaryThemeList, the 
HierarchicalSummary point of view (keyword) list, will 
be described using FIG. 64. 

[0394] The type of SummaryThemeList is declared as 
indicated by reference numeral 6400 in the drawing. 

10 [0395] Also, as indicated by reference numeral 6401 
in the drawing, SummaryThemeList is defined as having 
Summary Theme, which is a HierarchicalSummary 
viewpoint, as an element. SummaryTheme is defined 
as also having language information, which is text infor- 

1 $ mation. 

[0396] In addition, as indicated by reference numeral 
6402 in the drawing, SummaryTheme is defined as hav- 
ing identifier id as an attribute. And. as indicated by ref- 
erence numeral 6403 in the drawing, SummaryTheme 
is defined as having parentld, which is reference infor- 
mation for another high-level SummaryTheme. 
[0397] In this way, it is possible to achieve a hierar- 
chical notation for SummaryTheme. 
[0398] Next, the definition of HighlightLevel, which is 
information indicating what kind of segment configura- 
tion HierarchicalSummary has, will be described using 
FIG.65. 

[0399] HighlightLevel is declared as indicated by ref- 
erence numeral 6500 in the drawing. Also, as indicated 
by reference numeral 6501 in the drawing, HighlightLev- 
el is defined as having HighlightSegment which is in- 
formation on segments to be included in Hierarchical- 
Summary, as an element. 

[0400] Moreover, as indicated by reference numeral 
6502 in the drawing, HighlightLevel has HighlightLevel 
as an element. By this means, it is possible to have a 
HighlightLevel at a lower level than HighlightLeveL and 
a recursive HighlightLevel configuration can be provid- 
ed. 

[0401 ] Also, as indicated by reference numerals 6503 
to 6506 in the drawing, HighlightLevel has, as attributes, 
name, which is HighlightLevel name information, level, 
which is HighlightLevel priority level information, dura- 
tion, which is HighlightLevel length information , and the- 
melds, which is information on which SummaryTheme 
is to be referenced. 

[0402] In this way it is possible to link HighlightLevel 
to SummaryTheme. 

[0403] Next, an actual example of SummaryTheme 
created on the basis of a HierarchicalSummary defini- 
tion will be described using FIG. 66. 
[0404] SummaryThemeList 6600 includes Summary* 
Theme 6601a to SummaryTheme 6601 f. 
[0405] As indicated by reference numeral 6602a in 
the drawing, SummaryTheme 6601a is shown in Eng- 
lish. Also, as indicated by reference numeral 6603a in 
the drawing, SummaryTheme 6601 a has id "itemO" And, 
as indicated by reference numeral 6604a in the drawing, 
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the content of SummaryTheme 6601a is "baseball". 
[0406] As indicated by reference numeral 6602b in 
the drawing, SummaryTheme 6601b is shown in Eng- 
lish. Also, as indicated by reference numeral 6603b in 
the drawing, SummaryTheme 6601b has id "iternOI". 
Moreover, as indicated by reference numeral 6604b in 
the drawing, the content of SummaryTheme 6601b is 
"home run". And, as indicated by reference numeral 
6605b in the drawing, SummaryTheme 6601b has 
parentID "itemO". That is to say, SummaryTheme 6601 b 
is a SummaryTheme positioned at a lower level of Sum- 
maryTheme 6601a. 

[0407] As indicated by reference numeral 6602c in the 
drawing, SummaryTheme 6601c is shown in English. 
Also, as indicated by reference numeral 6603c in the 
drawing, SummaryTheme 6601c has id "iteml". More- 
over, as indicated by reference numeral 6604c in the 
drawing, the content of SummaryTheme 6601c is "bas- 
ketball". In addition, SummaryTheme 6601a has paren- 
tID "itemO". 

[0408] As indicated by reference numeral 6602d in 
the drawing, SummaryTheme 6601 d is shown in Eng- 
lish. Also, as indicated by reference numeral 6603d in 
the drawing, SummaryTheme 6601 d has id "iteml 1". 
Moreover, as indicated by reference numeral 6604d in 
the drawing, the content of SummaryTheme 6601 d is 
"three-pointer". And, as indicated by reference numeral 
6605d in the drawing, SummaryTheme 6601 d has 
parentID "iteml ". That is to say, SummaryTheme 6601 d 
is a SummaryTheme positioned at a lower level of Sum- 
maryTheme 6601c. 

[0409] As indicated by reference numeral 6602e in 
the drawing, SummaryTheme 6601e is shown in Eng- 
lish. Also, as indicated by reference numeral 6603e in 
the drawing, SummaryTheme 6601 e has id "iteml 2". 
Moreover, as indicated by reference numeral 6604e in 
the drawing, the content of SummaryTheme 6601 e is 
"slamdunk". And : as indicated by reference numeral 
6605e in the drawing, SummaryTheme 6601 e has 
parentID "iteml ". That is to say, SummaryTheme 6601 e 
is a SummaryTheme positioned at a lower level of Sum- 
maryTheme 6601c. 

[041 0] As indicated by reference numeral 6602f in the 
drawing, SummaryTheme 6601 f is shown in English. Al- 
so, as indicated by reference numeral 6603f in the draw- 
ing, SummaryTheme 6601 f has id "item2". Moreover, as 
indicated by reference numeral 6604f in the drawing : the 
content of SummaryTheme 6601 f is "soccer". 
[0411] By the fact of a SummaryTheme having a 
parentID in this way, it is possible to provide a link to 
another SummaryTheme. In addition, it is possible to 
link SummaryThemes hierarchically 
[0412] Next, a sample HierarchicalSummary descrip- 
tion using SummaryThemeList will be described using 
FIG. 67. 

[0413] As indicated by reference numeral 6700 in the 
drawing, HierarchicalSummary is declared as having 
the name "keyThemesSummaryOOl". 



[0414] Also, HierarchicalSummary is composed of a 
SummaryThemeList 6701 , a HighlightLevel 6702a with 
the name "summaryOOr, and a HighlightLevel 6702b 
with the name "summary002". 

5 [0415] SummaryThemeList 6701 has a Summary- 
Theme 6703a called "slam dunk". SummaryTheme 
6703a has id "E0". Also, SummaryThemeList 6701 has 
a SummaryTheme 6703b called "3-point shots". And 
SummaryTheme 6703b has id "El". 

10 [0416] Meanwhile, HighlightLevel 6702a has a seg- 
ment configuration as indicated by reference numeral 
6704a in the drawing. Also, as indicated by reference 
numeral 6705a in the drawing ; HighlightLevel 6702a 
has themelds "E0 n . That is to say, HighlightLevel 6702a 

'5 is linked to SummaryTheme 6703a that has id "E0". 
Thus, HighlightLevel 6702a has the SummaryTheme 
"slam dunk". 

[0417] HighlightLevel 6702b has a segment configu- 
ration as indicated by reference numeral 6704b in the 

20 drawing. Also, as indicated by reference numeral 6705b 
in the drawing, HighlightLevel 6702b has themelds "E1 ". 
That is to say, HighlightLevel 6702b is linked to Summa- 
ryTheme 6703b that has id "E1". Thus, HighlightLevel 
6702b has the SummaryTheme "3-point shots". 

25 [0418] In this way, it is possible to give Hierarchical- 
Summary a SummaryTheme, 

[0419] In this way, also, it is possible to link a High- 
lightLevel and SummaryTheme. Therefore, Highlight- 
Level and SummaryTheme can be described divided in- 

30 to separate configurations. 

[0420] In Embodiment 1 to Embodiment 11, it is pos- 
sible to use a user usage history, purchase history, or 
event history, a template prepared beforehand, or any- 
thing of the kind, for user preferences. 

35 [0421] Also, in Embodiment 1 to Embodiment 11, the 
content identifier, duration, keyword, priority level, or 
keyword priority related description method is not limited 
to these embodiments. 

[0422] Moreover, in Embodiment 1 to Embodiment 
40 11,3 terminal preference may be an ID representing a 
terminal category (for example, PC use or portable ter- 
minal use) ratherthan an actual terminal type orterminal 
capability value. Also, terminal preferences may be de- 
termined uniquely according to the terminal, or may be 
45 updated by means of a firmware or software version up- 
grade. 

[0423] Further, in Embodiment 1 to Embodiment 11, 
data may be other than audio/video or document data. 
[0424] Still further, in Embodiment 1 to Embodiment 
50 1 1 , it is possible for the user adaptive control section not 
to update user preferences. Moreover, there may be a 
plurality of different user preference descriptions for the 
same content. 

[0425] Also, in Embodiment 1 to Embodiment 10, 
55 there may be a number of segment and subsegment lev- 
els, from 1 upward . 

[0426] Moreover, in Embodiment 2, user preferences, 
terminal preferences, and network preferences may be 
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on the server side or a totally separate management site 
rather than on the terminal side. Also, network prefer- 
ences may be determined uniquely according to the 
contracted terminal service, or may be determined 
uniquely or dynamically according to the status of com- 5 
munication between the terminal and the server. 
[0427] Further, all or part of the operation of each part 
of the above-described present invention may be em- 
bodied in a program, that program stored on a storage 
medium that can be read by a computer, and that pro- 10 
gram executed using a computer, in order to realize the 
operation of each part. 

[0428] Still further, the above-described present in- 
vention may be realized using dedicated hardware that 
makes manifest the function of each part of the present '5 
invention. 

[0429] Also, all or part of the operation of each part 
included in the above-described present invention may 
be used in the form of a computer program product for 
execution by a computer. 20 
[0430] This application is based on the Japanese Pat- 
ent Application No.HEl 1 1 -344476 filed on December 3, 
1999, and the Japanese Patent Application No. 
2000-066531 filed on March 10, 2000, entire content of 
which is expressly incorporated by reference herein. 25 

Industrial Applicability 

[0431] As described above, according to the present 
invention, firstly, by providing user preference informa- 30 
tion as user preferences for each content, selecting a 
data segment according to user preferences, and per- 
forming resolution conversion based on segment prior- 
ity level and terminal capability, it is possible to perform 
data adaptation for each content in a form in which the 35 
user wishes to see it; and secondly, by acquiring infor- 
mation on the network transmission band as a network 
preference when content is distributed via a network, 
and adjusting the data quantity according to the seg- 
mentpriority and transmission band, it is possible to per- 40 
form data adaptation of content in the form in which the 
user wishes to receive it and in a scalable fashion ac- 
cording to the network status. 



Claims 

1 . A content adaptation apparatus comprising: 

a content data acquisition section which ac- 50 
quires content and metadata of said content; 
a user preference acquisition section which ac- 
quires user preference information relating to a 
user's preferences; and 

a user adaptation section which adapts said 55 
content to said user preferences using said 
metadata. 



2. The content adaptation apparatus according to 
claim 1 , wherein said user preference information 
is composed of user points of view for selecting ar- 
bitrary said segments from segments of said con- 
tent. 

3. The content adaptation apparatus according to 
claim 2, wherein said user points of view are as- 
signed a user priority level for each said user point 
of view. 

4. The content adaptation apparatus according to 
claim 2, wherein said metadata is composed of a 
segment point of view assigned to each said seg- 
ment and indicating the contents of said segment, 
and a segment priority level assigned to each said 
segment point of view. 

5. The content adaptation apparatus according to 
claim 4, wherein said user adaptation section ex- 
tracts said segment point of view from said meta- 
data, compares said extracted segment point of 
view with said user point of view included in said 
user preference information, and extracts said seg- 
ment that has a matching said segment point. of 
view. 

6. The content adaptation apparatus according to 
claim 4 f wherein said user adaptation section ex- 
tracts said segment point of view and said segment 
priority level from said metadata, compares said ex- 
tracted segment point of view with said user point 
of view included in said user preference informa- 
tion, and extracts a plurality of said segments that 
have a matching said segment point of view in high- 
to-low order of said segment priority level. 

7. The content adaptation apparatus according to 
claim 3, wherein said metadata is composed of a 
segment point of view assigned to each said seg- 
ment and indicating the contents of said segment, 
and a segment priority level assigned to each said 
segment point of view. 

8. The content adaptation apparatus according to 
claim 7, wherein said user adaptation section ex- 
tracts said segment points of view from said meta- 
data, compares said extracted segment points of 
view in order from a first user point of view to which 
a first user priority level was assigned to a second 
user point of view to which a second user priority 
level that is a lower user priority level than said first 
user priority level was assigned, and after extracting 
said segment that has said segment point of view 
matching said first user point of view, extracts said 
segment that has said segment point of view that 
has said second user point of view. 
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9. The content adaptation apparatus according to 
claim 5, wherein said user preference information 
includes display duration information for said con- 
tent. 

5 

10. The content adaptation apparatus according to 
claim 9, wherein said user adaptation section ex- 
tracts a number of said segments that can be dis- 
played within the time indicated by said display du- 
ration information. 10 

11. The content adaptation apparatus according to 
claim 5, wherein said user preference information 
includes display spatial range information or display 
position information for said content. is 

12. The content adaptation apparatus according to 
claim 11, wherein said user adaptation section ex- 
tracts a number of said segments that can be dis- 
played within the position range indicated by said 20 
display spatial range information or said display po- 
sition information. 

13. The data adaptation apparatus according to claim 

4, wherein with regard to said content, when there 25 
is a plurality of said segments that have the same 
said segment point of view, said same segment 
point of view is added to one of said segments that 
have said same segment point of view, and link in- 
formation for said same segment point of view is 30 
added for other said segments that have said same 
segment point of view, 

14. The content adaptation apparatus according to 
claim 4, wherein said content further comprises a~ 35 
segment point of view table that contains a plurality 

of said segment points of view assigned to an in- 
cluded plurality of said segments, 

15. The content adaptation apparatus according to 40 
claim 4, wherein said segment point of view has link 
information that provides correspondence between 
said segment point of view and a target said seg- 
ment. 

45 

16. The content adaptation apparatus according to 
claim 4, wherein said segment has link information 
that provides correspondence between said seg- 
ment and a target said segment point of view. 

50 

17. The content adaptation apparatus according to 
claim 1, further comprising: 

a terminal information acquisition section which 
acquires terminal information that is the 55 
processing capability of a terminal that per- 
forms predetermined processing in said con- 
tent adapted to said user preference informa- 



tion; and 

a resolution conversion section which performs 
resolution conversion of said adapted content 
according to said terminal information. 

18. The content adaptation apparatus according to 
claim 1 , further comprising: 

a network output section which outputts to a 
network said content adapted to said user pref- 
erence information; 

a network information acquisition section which 
acquires network information indicating the 
transmission band of said network; and 
a network adaptation section which adjusts the 
data quantity of said adapted content to be 
transmitted via said network according to said 
network information. 

19. The content adaptation apparatus according to 
claim 1 , wherein said user preference information 
is stored beforehand in this apparatus. 

20. The content adaptation apparatus according to 
claim 1 , wherein said user preference information 
is sent from said terminal that performs predeter- 
mined processing in said content adapted to said 
user preference information via a network. 

21. The data adaptation apparatus according to claim 
1 , wherein said user preferences are managed for 
each content identifier of said data. 

22. The data adaptation apparatus according to claim 
1, wherein said user preferences are defined by 
means of DTD of XML. 

23. The data adaptation apparatus according to claim 
1 , wherein said user preferences are defined by 
means of XML Schema. 

24. A content adaptation method comprising: 

a step of acquiring content and metadata of 
said content; 

a step of acquiring user preference information 
relating to a user's preferences; and 
a step of adapting said content to said user 
preferences using said metadata. 

25. The content adaptation method according to claim 
24, wherein: 

said user preference information is composed 
of user points of view for selecting arbitrary said 
segments from segments of said content; 
said metadata is composed of a segment point 
of view assigned to each said segment and in- 
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dicating the contents of said segment, and a 
segment priority level assigned to each said 
segment point of view; and 
said user adaptation step extracts said seg- 
ment point of view from said metadata, com- 5 
pares said extracted segment point of view with 
said user point of view included in said user 
preference information, and extracts said seg- 
ment that has a matching said segment point 
of view. 10 

26. A data adaptation method comprising: 

a step of sending metadata of content from a 
server holding said content to a terminal appa- '5 
ratus via a network; 

a step of comparing a segment point of view 
assigned to each segment of said metadata 
and indicating the contents of said segment, 
with a user point of view for selecting an arbi- 20 
trary said segment from segments of said con- 
tent, included in user preference information re- 
lating to a user's preferences held beforehand 
in said terminal apparatus; 

a step of sending the result of said comparison 25 
to said server; and 

a step of said server selecting a segment of said 
content according to said result of said compar- 
ison, and transmitting the selected segment to 
said terminal apparatus. 30 

27. In a computer, a computer-readable storage medi- 
um that stores a program comprising: 

a step of acquiring content and metadata of 35 
said content; 

a step of acquiring user preference information 
relating to a user's preferences; and 
a step of adapting said content to said user 
preferences using said metadata. 40 

28. The computer-readable storage medium according 
to claim 27, wherein: 



segment point of view. 

29. In a computer a program comprising: 

a step of acquiring content and metadata of 
said content; 

a step of acquiring user preference information 
relating to a user's preferences; and 
a step of adapting said content to said user 
preferences using said metadata. 

30. The program according to claim 29, wherein: 

said user preference information is composed 
of user points of view for selecting arbitrary said 
segments from segments of said content; 
said metadata is composed of a segment point 
of view assigned to each said segment and in- 
dicating the contents of said segment, and a 
segment priority level assigned to each said 
segment point of view; and 
said user adaptation step : in a computer, ex- 
tracts said segment point of view from said 
metadata, compares said extracted segment 
point of view with said user point of view includ- 
ed in said user preference information, and ex- 
tracts said segment that has a matching said 
segment point of view. 



said user preference information is composed 45 
of user points of view for selecting arbitrary said 
segments from segments of said content; 
said metadata is composed of a segment point 
of view assigned to each said segment and in- 
dicating the contents of said segment, and a so 
segment priority level assigned to each said 
segment point of view; and 
said user adaptation step, in a computer, ex- 
tracts said segment point of view from said 
metadata, compares said extracted segment 55 
point of view with said user point of view includ- 
ed in said user preference information, and ex- 
tracts said segment that has a matching said 
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< KeywordList > 

< Keyword id=T>A</Keyword> 

< Keyword id= "2">B</Keyword> 

< Keyword id="3">C<Keyword> 
</KeywordList> 

< Segment > 

< Keyword idref="l" p="2"/> 

< /Segment > 

< Segment > 

< Keyword idref="2 w p= w 37> 



\ 



M801 



j 
\ 



> 1803 



> 1804 



< /Segment > 
<Segment> 

<Keyword p="4">C</Keyword> 

••• 

< /Segment > 



J 



>2001 



FIG. 21 



SDOCID: <EP 1246070A 1 _l_> 



51 



EP 1 246 070 A1 



LU 


CSJ 

3= 

LU 


CO 


> 


> 


> 


o 


LL. 
O 


LL 
O 


1 — 




I— 

z: 


o 

Q. 


o 


o 
a. 


«\ 







CM CM 

o o 



CM 
O 



LU 



o 



O 

T— 

CM 



C\J C\J CM 



c 

CM 

o 

CM 



CM 
C\J 



o 
o 



CO 

o 



CM 



CO 




o 


o 






~/ 










LU 
> 


LU 
> 




LU 

O 




J — 


ar 




o 


o 


cc 







CD 
LU 
CO 



O 



LU 

CD 
LU 
CO 



oo 


CD 


o 


O 










CM 




EW 


LU 
> 
UJ 


> 




O 




f— 






o 


O 


cc 







in 
o 



CM 



o 












5, 






1 




LU 


LU 


5 


> 




O 




H- 


I0R 


o 


cc 



CD 
u_ 



CD 
LU 
CO 



OOCID: <EP 1246070A1_I_> 



52 



EP 1 246 070 A1 



<KeywordList> 

<Keyword id="l">A</Keyword> \ 21 02a 

2§01 . 

<Keyword id="2">B</Keyword> V 2102b 

2302 f 2101 
<Keyword id="3">C</Keyword> J-2102C 

</KeywordList> 



<Segment> 
<Keyword p="2' , > A</Keyword> 
2107 r 2106 

</Segment> 
< Segment > 
<Key word p= " 3" >B</Keyword> 
2109"" ^2108 

</Segment> 
<Segment> 
<Keyword p="4 B >C</Keyword> 

"^Tri^^Tio 

</Segment> 



> 2103 



} 2104 



> 2105 



FIG. 23 
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<KeywordList Key word= " Team A"> 
<Priority idref = " 1 " v >3</Priority > 

^22033 2204a 

<Priority idref ="n">2</Priority> 

^2203^^^2046 

<Priority idref= B 2" s >55/Priority> 

^22030 2204c 

</KeywordList> 

<KeywordList Keyword="Team B"> 

<Priority idref ="2">4<^riority> 

"2253d ^204d 
<Priority idref = " 3",>5^Priority> 

"2203e 2204e 
<Priority idref ="l" > >25/Priority> 

2203f~^2204f 

</KeywordList> 



<Segment id=T> 

236la 

<Segment> 

<Segment id="2"> 
2301b 

</Segment> 
<Segment id="n"> 

235Tri 

</Segment> 



2201a 



> 2201b 



2201 n 



> 2202a 



j 



2202b 



FIG. 25 
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<KeywordList Keyword="TeamA" 

<Priority id="pl01" idref=T >3</Priority> 

^2503a" ^2403a 2404a 
<Priority id="pl02" idref = "n">2</Priority> 

^2503^ "2403b 2404b 
<Priority id="pl03" idref="2">5<yPriority> 

N 25(53c' "2403c 2404c 
</Key wordList > 



2402a 



<KeywordList Keyword="TeamB"> 

<Priority id="p201 n idref="2">4</Priority> 

^2503? "~2403d 2404d 
<Priority i d="p202 " idref="3" > >55/Priority> 

2503e "24036 2404e 

<Priority id="p203" idref="l">2</Priority> 

2503f~^ 2403T"2404f 

</KeywordList > 

<Segment id=T> 

2B0Ta 

<Keyword idrefs="pl01 p2037 > 
2502a ' ^2502b 

< /Segment > 
Oegment id="2"> 
S 250tb 

<Keyword idrefs="pl02 p2017> 
2502c "~2502d 

</Segment> 
<Segment id="n"> 
25^1n 

<Keyword idrefs="pl02 "/> 



2502e 



</Segment> 



> 2402b 



> 2401 a 



j 



\ 2401 b 



J 



\ 2401 n 



J 



FIG. 27 
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} 2603b 
\ 2603c 



<KeywordList Keyword =" Team A"> 

<Priority idref ="17> \ 2603a 

"27028 
<Priority idref = " n" / > 

""2702b 
<Priority idref ="2"/> 

2702cT 

</KeywordList > 

< Key wordList Keyword = " TeamB"> 

<Priority idref ="27> 

^2702^ 
<Priority idref = "37> 

"2762e 
<Priority idref = "17> 

"2702f 

</KeywordList > 

<Segment id=T> 

</Segment> 

<Segment id= n 2"> 
2701b 

< /Segment > 

< Segment id="n w > 
</Segment> 



} 2603d 
}2603e 
}2603f 



> 2602a 



> 2602b 



j 



\ 2601 a 



J 



2601b 



J 



V2601n 



FIG. 29 
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<KeywordList Keyword="TeamA"> 

< Priority idref="2 n"/> 

2803a 2803c 

< Priority idreT=^17> 

</KeywordList> 



> 2802 



J 



< Segment id=T> 

2§frfa 

</Segment> 

< Segment id= B 2"> 

2901 b 
</Segment> 

< Segment id="n"> 

2§£rfn 

</Segment> 



^ 



\ 2601 a 



J 



2601b 



2601c 



FIG. 31 
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<\-4mmmmmmmmmmmmmmmnummm -> 

<! Definition of the UserPreference DS --> 
<j-l########t################### ####### ^ #################### _> 

<! ELEMENT UserPref erence(UserIdentifier,UsagePreferenceses ? ) > 

V v ' ^ „ " V ^ ^ ' 

3201 3202 3203 

<!-4###############m^ 

<!-- Definition of the Userldentifier DS --> 

<\-mmmmmmmmmmmnmmmmmmmmmm--> 

<!ELEMENT Userldentifier EMPTY > ^3204 
<!ATTLIST Userldentifier 
protectedft rael false | user) " true" 
3204 

userName^ CDATA "anonymous" 
3205 

> 

<!-######################################################### ft###### ..> 
<{-- Definition of the UsagePreference DS --> 
<!--################################################################..> 

<!ELEMENT UsagePreferences(BrowsingPreferences*)> \ 3206 

' ■> / 

<!ATTLIST UsagePreferences 3207 

allow AutomaticUpda te(true|f alse I user) "true" 
3208 

<\-m*immmmmmmnmmmmmmmffl^ 

<!-- Definition of the BrowsingPreference DS --> 
<!-4#################^^ 

<!ELEMENT BrowsingPreferences( SummaryPreferences* ) ^-3209 
<!ATTLIST BrowsingPreferences 3210 
protected(true|false|user) "true" 

jMreferenceValue , CDATA "1 00 "> 
3212 ' 

FIG. 32 
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<!ELEMENT SummaryPreferences (PreferredSummaryTheme* ) 



Summary Duration 1) > 
3303 

<!ATTLIST SummaryPreferences 
greferenceValue CDATA lOO" 
^ 3304 ' 



<!ELEMENT Pref erredSummaryThemeC # PCDATA) > 
<!ATTLIST PreferredSummaryTheme 
xml:lang CDATA # IMPLIED 
3306 ' 

preferenceValue CDATA "100" 
> 3307 

<!ELEMENT SummaryDuration(# PCDATA) > ^3308 



<!-- Definition of the SummaryPreferences DS 





FIG. 33 
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<UserPref erence > ^ 3400 

<UserIdentifier protected="true n userName= w Bob w /> "}3401 
<UsagePrerferences allowAutomaticUpdate= rt false"> } 3402 
<BrowsingPreferences protected="true w > ^3403 

<SummaryPref er ences > ^} 3404a 

<PreferredSummaryTheme 

preferenceValue="500 M >Nakata</PreferredSummaryTheme> 
<PreferredSummaryTheine 

pref erenceValue= "400" >Soccer</ Pref erredSummaryTheme> 
<PreferredSummaryTheme 

pref erence Value= n 200" > Japan< /Pref erredSummaryTheme> 
<SunmaryDuration>PT5M</SummaryDuration> ^3408a 
</Summary Pref erences > 

<SummaryPreferences> 3404b 
<PreferredSummaryTherne 

preferenceValue= n 500">Headline</PreferredSummaryTheme> 
<PreferredSummary Theme 

preferenceValue= "500" >Stock</Pref erredSummaryTheme> 
<PreferredSummaryTheme 

preferenceValue= n 300' , >Sports</PreferredSummaryThenie> 
<SunmaryDuration>PT3M</SummaryDuration> ^ 3408b 
</SummaryPreferences> 

</BrowsingPreferences> 

<AJsagePreferences> 

</UserPref erences > 



> 3405a 



'3406a 
►3407a 



-3405b 



| 3406b 
►3407b 



FIG. 34 
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<!•-#######################################################--> 
<!-- Definition of the AudioVisualSegment DS --> 
<!--#######################################################-> 

<!ELEMENT AudioVisualSegment , ( PointOfView *,MediaTirne)> J-3501 

3502 3503 3504 

<!ATTLIST AudioVisualSegment 

id ID # REQUIRED 
href CDATA # IMPLIED 
idref CDATA # IMPLIED 

> 

<!--######################################## ############### -> 

<!-- Definition of the PointOfView DS --> 
<!--########################################f ############## --> 

<!--main definition of the PointOfView DS--> 
<! ELEMENT PointOfView ( Supplementallnfo ? ,Va]ue+)> y 3508 
<! ATTLIST PointOfView 3509 3510 

id ID # IMPLIED). 351 1 

viewpoint CDATA # REQUIRED )• 351 2 

> 

<!-- definition of Value D--> 
<! ELEMENT Value(# PCDATA) y 3513 
<! ATTLIST Value 
id ID # IMPLIED } 3514 

> 

FIG. 35 
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<!--############### #####m 

<!-- Definition of the Supplementallnfo DS --> 
<!--###########P^ 

<!ELEMENT SupplementalInfo((FreeTextAnnotation I ^ 

" ' > 3601 

StructuredAnnotation ) + )> 3602 j 

^ ~ 3602 ; 
<! --Definition of the FreeTextAnnotation DS-> 

<! ELEMENT FreeTextAnnotation (#PCDATA)> } 3604 
<!ATTLIST FreeTextAnnotation "\ 

xml : lang CDATA # IMPLIED f 3605 

J 

> 

<!-- Definition of the StructuredAnnotation DS--> 

<! ELEMENT StructuredAnnotation(Who ? I WhatObject ? I ) 

^ — *v ^ ^ -v ^ I 

WhatAction ? I Where ? | When ? I Why^°l 3603 f 3606 



i ^ yy licre ^ i ^ vvaen f j w ny r ; w > 

3609 1 3610 3611 36llf 
<!ELEMENT Who(# PCDATA)> 

<!ELEMENT What0bject(# PCDATA) > 

<!ELEMENT WhatActionC # PCDATA)> 

<!ELEMENT Where( # PCDATA) > 

<!ELEMENT When( # PCDATA) > 

<!ELEMENT Why(# PCDATA)> 

<!ATTLIST StructuredAnnotation 

id ID # IMPLIED 

xml : lang CDATA # IMPLIED 




> 




FIG. 36 
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<! -####################################################### - > 

<! -Definition of the MediaTime DS --> 
<!-^################################################ # ## ### -> 

<!ELEMENT MediaTime ( MediaTimePoint^ediaDuration) > 1 3701 

3702 3703 

<\-mmmmmmmmmmmmmmmmmmmm--> 

<!- -Definition of the MediaTimePoint D --> 
<!--#################################### # # ## # ############## -> 

<! ELEMENT MediaTimePoint (# PCDATA) > | 3704 

<! --#######################################################- > 

<! -Definition of the MediaDuration D --> 
<!--####################################### # # ############## -> 

<!ELEMENT MediaDuration (# PCDATA) > } 3705 

FIG. 37 
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<AudioVisualSegment > 

<PointOfView 4^1," viewPoint= "TeamA"> 
1701 

<Value> 5</Value > 

1^702 

</PointOfView> 



> 1602 



</ Audio VisualSegment > 

<AudioVisualSegment > 
<PointOfView> 



< Value idref=T>2</Value> 



</PointOfView> 



1703 1704 
Vi 



> 1603 



</ Audio VisualSegment > 



FIG. 38 
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<PointOfView> 

<viewPoint id= " 1" >A</viewPoint> J 1802a 

190~1a T§02a . 
<viewPoint ^d=3 n >B</viewPoint> \l802b >1801 

1901b1^02b 

<viewPoint Ki=jT >C</viewPoint> \ 1 802c 

1901c 1902c 
</PointOfView> 

<AudioVisualSegment> 



<PointOfView idref="l"> 

^"^9038 
<Value>2</Value> 

1904a 

</PointOfView> 



</Audio VisualSegment > 



<AudioVisualSegment > 

<PointOfView idref="2"> 

_ r 1903b 

<VaIue>J3_</Value> 

1904b 

</PointOfView> 



</Audio VisualSegment > 

FIG. 39 



yi803 



M804 



</Audio VisualSegment > 

<Audio VisualSegment> "\ 

<PointOfView idref="3"> 

. nT , 1903c 

<Value>4</Value> >1805 

1^9040 

<PointOfView> 
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<PointOfView> 

<viewPoint id = " 1" > A</vie wPoint> 

<viewPoint id="2">B</viewPoint> ^ 1801 

<viewPoint id="3">C</viewPoint> 
</PointOfView> 
< AudioVisualSegment> 

</PointOfView idref=T> 
< Value >5</Value> 
</PointOfView> 



>1803 



>1804 



</AudioVisualSegment > 

< AudioVisualSebment > 
<PointOfView idref="2"> 
<Value>3</Value> 
</PointOfView> 

</ Audio VisualSegment > 

<AudioVisualSegment > 
<PointOfView viewPoint="C"> 

<Value> 4 </Value> ^2001 
<PointOfView> 
</AudioVisualSegment > 



FIG. 40 
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<PointOfView> 

<viewPoint id=T>A</viewPoint> } 21 02a 

2301 > 

<viewPoint id= "2" >B</viewPoint> } 21 02b \ 21 01 

2302 

<viewPoint id="3">C</viewPoint> \ 21 02c 
2§03 j 

</PointOfView> 
<AudioVisualSegment> 



<PointOfView viewPoint="A> 

2106 

<Value>5</Value> 

2107 

</PointOfView> 

</Audio VisualSegment > 

<AudioVisualSegment > 

<PointOfView viewPoint="B"> 

2108 

<Value>3</Value> 

2109 
</PointOfView> 



^2103 



^2104 



</Audio VisualSegment > 

<AudioVisualSegment> 

<PointOfView viewPoint=CC> 

2110 

<Value>4</Value> ^-2105 

2VM 

</PointOfView> 

</Audio VisualSegment > 

FIG. 41 
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<PointOfView viewPoint="TeamA"> 

<Value idref= " 1" >3< /Value > 

^2203^ 2204a 
< Value idref="2 ">2</Value> 

2203b 2204b 

<Value idref="n">5</Value> 

^203cT 2204c 
</PointOfView> 

<Point0fView viewPoint="TeamB n > 

<Value idref="2">4<Value> 

^22636 5&4d 
<Value idre f ="3 ">5</Value> 

2203ef 2204e 
<Value idr.ef="l" >2</Value> 

</PointOfView> 
<AudioVisualSegment id="l"> 

« « • 

</AudioVisualSegment> 
<AudioVisualSegment id=*2"> 

• • • 

</AudioVisualSegment> 
<AudioVisualSegment id="3"> 

</AudioVisualSegment> 



\ 2202a 



y 2202b 



2201a 



\ 



> 2201 b 



2201c 



FIG. 42 
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<PointOfView viewPoint="TeamA"> 

<Value id ="pl01 * . idref = " 1" >3</Value> 

^2503^ V ~2403sf 2404a 

< Value .id="j)102 " ,idref="2> 2</Value> 

^503tf ^2403b" 2404b 

<Value id =^pl03 " idref="n">5</Value> 

^2503cT 
</PointOfView> 



2403c 2404c 



> 2402a 



<PointOfView viewPoint="TeamB"> 



<Value id ="p201 " idref""2".>4</Value> 

^2503cf ^2403cT 2404d 

<Value ,id="p202 n idrefj="3> 5</Value> 

^2503^ ^2AQ3e 2404e 
<Value id="p203 " , idref="l ">2<Value> 

2503f 2403f 2404f 

</PointOfView> 



} 2402b 



< Audio VisualSegment id= " 1" > 
</PointOfView> 2501 3 

<Value idrefs="pl01 p203"> 

25£)2a 2502b 
</PointOfView> 



\ 2401a 



< /Audio VisualSegment> 



< Audio VisualSegment id^^" > 
<PointOfView> 2501b 

< Value idrefs="pl02 p20r> 

25$2c 2502d 
</PointOfView> 



> 2401b 



< /Audio VisuaISegment> 



FIG. 43 
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<AudioVisualSegment id="3"> 



<PointOfView> 



2501c 



< Value idrefs="p202" > 

25&2e 

</PointOfView> 



} 2402c 



< /Audio VisualSegment> 



FIG. 44 
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<PointOfView viewPoint= " TeamA"> 



<Value jdref="1 7> 

^2702^ 
< Value idref="n7> 

*2702b" 
< Value idref="2 7> 

m . ^ 2702cT 

</PointOfView> 



^2603a 
| 2603b 
\ 2603c 



\ 2602a 



< PointOfView viewPoint= "TeamB" > 



< Value .idref="2 "/> 

^2702cT 
<Value idref="3 7> 

^2702^ 
< Value idref="17> 

2702f 

</PointOfView > 



j 2603d 
}2603e 
^2603f 



< Audio VisualSegment id= " 1"> 

275Ta 

< /AudioVisualSegment> 

< Audio VisualSegment id="2"> 

^2701b 

< /Audio VisualSegment> 

< Audio VisualSegment id="3"> 

27<5Tc 

</AudioVisualSegment> 



} 2602b 



j 
\ 



> 2601 a 



2601b 



2601c 



FIG. 45 
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<PointOfView viewPoint="TeamA"> 

< Value idref="3 !"/> 

^2803a' 2803c 
< Value idref="27> 

</PointOfView> 



^2802 



< Audio VisualSegment .id="l. "> 

2901a 

</AudioVisualSegnient> 

<AudioVisualSegment id= w 2> 

2901b 

< /Audio VisualSegment > 

<AudioVisualSegment id=="3 ,, > 

295tc 

</ Audio VisualSegment> 



2601a 



> 2601b 



2601c 



FIG. 46 
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<! - #########^ 

<!-- Definition of UserPreferences DS --> 
<! - mmummmmm ^ 

<element name= " UserPreference"^ 

" 3201 ' 

type= f, mpeg7:UserPreferenceType w /> 

<complexType nam€="UserPreferenceType"> 

<element name= ''UserIdentifie^ ,, type="mpeg7:UserIdentifie^Type' , 

rninOccurs= " l"rnaxOccurs= T/> 
<element name^UsagePreferences" 

type= n mpeg7 : UsagePreferencesType" 

minOccurs= "0"maxOccurs= " 17 > 
</complexType> 

FIG. 47 



J 3202 
1 3203 
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<!-#######################################################--> 

<!-- Definition of UsagePreferences DS --> 

< u -#######################################################--> 



< element name= " UsagePref erence^ 

3203 

type ="mpeg7:UserPreferenceType'7> 

< complexType name= " UserPref erenceType" > 

< element name= " FilteringAndSearchPref erences" > 

S 4§02 " 1 4801 

type= " mpeg7:FiIteringAndSearchPref erencesType" 

minOccurs = " 0" maxOccurs= " unbounded" /> ' 

< element name= " BrowsingPreference^ ^ 

type= n mpeg7:BrowsingPre^erenceType" ' 4803 

minOccurs = " 0" maxOccurs= " unbounded" /> 

< attribute name fallow AutomaticUpdate^ , 

3208 

type= " mpeg7:allowAutomaticUpdateType" 
use= " default" value= " false" /> 
</complexType> 



FIG. 48 
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<!-- Definition of BrowsingPreferences DS 



<element name= " BrowsingPreferences" 

typ e = " mpeg7:Br o wsingPref erencesTy pe" /> 
<complexType name= " Bro wsingPref erencesType"> 

<element name= " SummaryPreferences" 

" 3^10 ' 

type= n mpeg7:SummaryPreferencesType" 

minOccurs= "0" maxOccurs= n unbounded" /> 
<element name— "PreferenceCondition" 

type= " mpeg7: PreferenceConditionType " 

4902 

minOccurs= " 0 " maxOccurs = " unbounded" f> 



>4900 



M901 



<attribute name= j)rotected^ type="mpeg7:protectionType n 

3211 

use=" default" 
value = true n /> 

</attribute name= ^preferenceValue w type== "integer" use= " default' 

value -"1 00" /> 3212 
</cornplexType> 



FIG. 49 
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<!--#####^ 

<!-- Definition of SummaryPreferences DS --> 

<!--######^^ 



<simpleType name= " summaryComponentType" base = "string^ 
<enumeration value="visual7> 

< enumeration value= " visual/key Frames" / > 
Enumeration value= " visual/key VideoClips" /> 
Enumeration value= " visual/key Themes" /> 
<enumeration value=" audio" /> 
<enumeration value ==" audio/key Sounds"/ > 
Enumeration value= " audio/key AudioClips" f> 
<enumeration value="audio/keyThemes"/> 
<enumeration value= n textual" /> 

< enumeration value= " textual/key Themes" /> 
</sirnpleType> 

<element name= " SummaryPr eferences^ 

32TO ZT „, 
type ="mpeg7 : SummaryPreferencesType /> 

<complexType name= "SummaryPref erencesType"> 

<element name= "SummaryTypePreferencesj , minOccurs="0" 

maxOccurs=" unbounded" > 5001 

<complexType base="mepeg7 : summaryComponentType" 
derivedBy = "extension "> 

<attribute name= " preferenceValue" t ype= "integer" use= " default' 
value="1007> 3304 

< fc omp lex Ty p e > 
</element> 

< element name= " Pref erredSummaryTheme" minOccurs= " 0" 



3362 
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3303 



>5^0^ 



^5102 



J 



<complexType base= "mpeg7 : TextualType"derivedBy= " extension n > 
<attribute name— ^pref erenceValue " type = integer" use = default" 

value="1007> 3307 
</complexType> 

</element> 

<element name= "summary Duration" 
type= w mpeg7:mediaDurationType' f 

minOccurs= " 0" maxOccurs^ " 17> 
<element name= "MinSuminaryDuration" 
type= w mpeg7:mediaDurationType ,, 

minOccurs= " 0" maxOccurs= m 17> 
<element name= "MaxSummaryDuration" 
type= " mpeg7:mediaDurationType" 

minOccurs= "0" maxOccurs = " 17> 
<element name= "NurnOf Keyframes" type= w positiveInteger" 

min0ccurs= " 0 n maxOccurs = " 1 7> 
< element name= "MinNumOfKeyframes f 'type= f 'positiveInteger'' 

minOccurs= " 0" maxOccurs = " 17> 
<element name "MaxNumOfKeyframes"type = "positiveInteger" 

minOccurs= "(T maxOccurs = " 17> 
<element name= " NurnOf Chars" type = "positiveInteger" 

minOccurs= " 0"maxOccurs= " l n /w> 
<element name="MinNumOfChars , 'type= ,, positiveInteger' , 

minOccurs= " 0" maxOccurs == " 17> 
<element name= "MaxNumOf Chars" type="positiveInteger" 

minOccurs= n 0" maxOccurs = 71"> 
<attribute name="preferenceValue n type = integer"use = default 
value- "1007> 
</complexType> 



FIG. 51 
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<UserPreference> j 5200 

<UserIdentifier protected="true n > > 5201 

<UserName xml:lang="en w >Mike</UserName> J 
<UserIdentifier> 

<UsagePreferences allowAutomaticUpdate= ff false' , > } 5202 

<BrowsingPreferences protected= n true" ^} 52.03 

<SummaryPreferences> y 5204 

<PreferredSummary Theme >Free - ^ 

L 5205 

kicks </Pref erredSummary Theme > j 

<PreferredSummaryTheme>Goals</PreferredSunim \5206 
ary Theme > J 

<SummaryDuration>PT5M</SummaryDuration> |5208 
</SummaryPreferences> 
</BrowsingPreferences> 
<UserPreference> 



FIG. 52 
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<!-#######################^ 

<!--Definition of "Segment DS" --> 

<element name = " Segment" type = " mpeg7:SegmentType7 ^ 
<! -Definition of the Segment itself --> 

<complexType name= " SegmentType" abstract= " true"> *t 5300 

< choice minOccurs= " 0" maxOccur s= T> 
<element name="MediaInformation" 

type= "mpeg7:MediaInfonnationType ,f I 5301 

minOccurs= " 0" maxOccurs= T/> 

<element name="MediaLocator f, type="mpeg7:MediaLocatorType ff /> ^ _ 
</choice> yt>302 

<element name=XreationInformation" "\ 

type= w mpeg7:CreationInformationType"minOccurs="0" 1 5303 

max0ccurs= w 17> I 

<element name="UsageInformation" S 

type= " mpeg7:UsageInf ormationType" I 5304 

minOccurs = "(Tmax0ccurs= n 17> J 

<element name= w Text Annotation" ^ 

type= B mpeg7:TextAnnotationType" 1 5305 

minOccurs= " 0" maxOccurs= " unbounded" / > < 



FIG. 53 
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<element name="Point0fView f, type= w mpeg7:Point0fNiewType" 
minOccurs= n (T 1 5307 

maxOccurs= " unbounded7> 
<element name= " SegmentDecomposition" 
type= " mpeg7:SegmentDecompositionType" i 5308 

minOccurs="0"max0ccurs="unbounded7> J 
<attribute name = "id" type ="ID W use = * required 7> } 531 1 

<attribute name= n href" type = " uriRef erence" use= " optionar/> } 5312 

<attribute name="idrertype= ,f IDREF'> S 

<refEltName= w mpeg7:Segmenruse="optionar /> j 531 3 

</complexType > 

</Segment > 



FIG. 54 
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<!-- Definition of Audio VisualSegment DS --> 
<u############^^ 



<element name= " AudioVisualSegment" 
type= n mpeg7:AudioVisualSegmentType" 

equivClass="mpeg7:Segment w /> 
<complexType name=" Audio VisualSegmentType" 
base="mpeg7 : SegmentType" 

derivedBy= rt extension "> 
<element name= w MediaTime"type="mpeg7:MediaTiIneType r, 
minOccurs= B l" 
maxOccurs= w lV> 

<! -Restriction of refEltName to Audio VisualSegment DS--> 
<attribute name= n idref"type= ff IDREF n 
refEltName= w mpeg7: Audio VisualSegment" 

use= B optional" /> 
</complexType> 



5501 



J 



\ 5502 



J 



\ 5504 



FIG. 55 
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<!-- Definition of PointOfView DS - > 

< !-^#####f ^ > 

<!-- Primitive Importance type definition- -> ^ 

< complexType name= " Primiti velmportanceType" 
base= "mpeg7:zeroTo0neType" 

derivedBy = "extension" > r 5603 

<attribute name=="idref"type= w IDREF"use=' , optionai"/> > 
</complexType> |5604 

<element name= "PointOfView" type = "mpeg7:PointOfViewType"/> ^ 
<!--Befinition of PointOfView type~> f5600 
<compiexType name= "PointOf ViewType"> 
<element name="SupplementalInfo" 
type="mpeg7 : TextAnnotationType" 

minOccurs= " 0" maxOccurs = " 1 7 > 
<element name= "Value" type= "mpeg7:PrimitiveImportanceType" 

minOccurs="r maxOccurs =" unbounded" /> J5602 
<attribute name="id rt type="ID"use="optionar/> | 
<!--To accommodate specific semantic viewpoint--> J 
<attribute name="viewPoint"type="string"use=" required"/ } 5606 

</complexType> 

FIG. 56 
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5703a 



Y 5702a 



<!-- Description of PointOfView DS embedded in video structure--> 
< Audio VisualSegment id="FootBallGame"> }5700 

<SegmentDecomposition decompositionType=" temporal "> ^5701 a 
< Audio VisualSegm wnt id= " segl " > 

<PointOfView viewPoint="TeamA"> 

<Value>0.3</Value> 
</PointOfView> 

<PointOfView viewPoint="TeamB"> 

<Value>0.7</Value> 
</PointOfView> 
<MediaTime > .. . < /MediaTime> 
</AudioVisualSegment > 
<AudioVisualoSegment id= " seg2"> 

<PointOfView viewPoint= "TeamA" > 

<Value>0.5</Value> 
</PointOfView> 

<MediaTime>...</MediaTime> } 5704b 

</ Audio VisualSegment> 



►5703b 



•5704a 



\ 



> 5703c 



J 



\ 5702b 



</Audio VisualSegment id= " seg20 "> 

<PointOfView viewPoint="TeamA"> 

<Value>0.8</Value> 
<PointOfView> 

<PointOfView viewPoint="TeamB"> 

<Value>0.2</Value> 
< PointOfView > 



- 5703d 



>5703e 



> 5702c 



FIG. 57 
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<MediaTiroe>...</MediaTime> } 5704c 1 



5702c 



</AudioVisualSegment> 



</SegmentDecomposition> 

<SegmentDecomposition decompositionType= " temporal"> 
<AudioVisualSegment id="2segl"> 

<PointOfView viewPoint="TeamA"> 

<Value>0.3</Value> 
</PointOfView> 
<MediaTime>...</MediaTime> 
</AudioVisualSegment> 
<AudioVisualSegment id="2seg2"> 

<Point0f View viewPoint= " Te amA"> 

< Value >0.5</Value> 
</PointOfView> 
<MediaTime>...</MediaTime > 
</AudioVisualSegment> 



> 5703f 
} 5704d 



^.5701 b 



> 5702d 



► 5703g 



} 5704e 



J 



5702g 



< Audio VisualSegment id="2seg20"> 
< PointOf View vie wPoint= " TeamA" > 

<Value>0.8</Value> 
</PointOfView> 

<MediaTime>...</MediaTime> | 
</AudioVisualSegment> J 



\ 5703h 



J 

5704f 



5702f 



</SegmentDecomposition> 

FIG. 58 



<MediaTime>...</MediaTime> 
</AudioVisualSegment> 

FIG. 59 



5DOCID: <EP 1246070A1 J_> 



88 



EP 1 246 070 A1 



<!-- Description of video structure --> 

<VideoSegment id="FootBaUGame' , > }6000 

<SegmentDecomposition decompositionType="temporar> 
<VideoSegment id="segr> 

<MediaTime>...</MediaTime> 
</VideoSegment > 
</VideoSegment id="seg2"> 

<MediaTime > ... < /MediaTime> 
</VideoSegment > 



}6001 



} 6004a 



J 



\ 6002a 



}6004bl 6 002b 



J 



<VideoSegment id="seg20"> 

<MediaTime>...</MediaTime> 
</VideoSegment> 



} 6004c J6002C 



</SegmentDecomposition > 

<MediaTime>...</MediaTime> 
</VideoSegment> 



}6004d 



<!-- Description of PointOfView DS associated with video structure - 
-> 

<PointOfView vie wPoint= "Team A"> }6005 

< Value idref="segl">0.3<Value> \ 6006a 

< Value idref="seg2">0.5</Value> ) 6006b 

< Value idref="seg2(r>0.8</Value> }-6006c 

FIG. 60 
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< ] --^mmmmmmmmmnmmmmmuumummmm--> 

<!-- Definition of HierachicalSummary DS ~> 

<i-mmummmmmmmmmmmmmmmnmmmmu--> 

<simpleType name="summaryComponentListType"base= "string" ^ 
derivedBy="list"> 

<enumeration value="keyFrames"/> 
Enumeration value= "key VideoClips7> 
<enumeration value= "keyAudioClips"/> 
Enumeration value=" key Themes"/ > 
Enumeration value= "unconstrained"/> 
</simpleType > 

< element name= "HierarchicalSummary" 
type = " mpeg7:HierarchicalSummaryType" / > 
<complexType name= "HierarchicalSummaryType" 
base= "mpeg7:SummaryType" 
derivedBy= " extension" > 

FIG. 62 



> 6204 



6200 



J 
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<\-mmmmmmtmmummmmmummummmtmmm--> 



<!-- Definition of SummaryThemeList DS 

<i-mmmmmnmmmmmmnmmmmmmumunmm-- 



> 

> 



<element name=" SummaryThemeList" > 
type="mpeg7:SummaryThemeListType7> I 6400 

<complexType name= *SummaryThemeListType"> J 
<element name=" Summary Theme"maxOccurs="unbounded B > \ 
<complexType base="mpeg7:TextualType"derivedBy=' , extension"> J 64 ° 1 
Ottribute name="id type" = "ID"/> }6202 
<attribut name="parentId"type="roREF"use="optiomaI7> }6203 
</complexType> 
</eIement> 
</complexType> 

FIG. 64 
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<SuramaryThemeList > 



^ 6600 



<SummaryTheme pcml : lang="en; 

„„ , 6602a ^ 6601a 

v iQ= itemOL , > v basebail / </SummaryTheme> 
~6603i 660la 

<SummaryTheme xml:lang="en"[d= "itemO; " 

^arentId= w itemO ;>^ om | 6 n^SummaryTheme> ' 
<Sun»yTheme .x^g^W 

. . 6l0lc ^ 6601c 

( jd="iteml J'> v basketball< :/SummaryTheme> 

e 6603c ^ 6604c 
<SummaryTheme v xml,iang= " en ," [d = " iteml \ " ^ 

t parentld="itemi; >^hre^PO^</SuWary Theme > J 

<Summa£y Theme y Xmlrllng^en^ \ 

^unly:/SunimaryTheme> 6602e ^03i 66051 ' 6604e f 60 ^ 

6604e J 
<SummaryTherae ^ xmlilang^'en ; 

v id= "item2; > v §occe£ / < /SummaryTheme> 
<SummaryThemeList > 

FIG. 66 
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<!-- Description of video structure --> 

<VideoSegment id= "FootBaUGame"> }6000 

<SegmentDecomposition decompositionType="temporar> ^-6001 
<VideoSegment id="segl"> 

<MediaTime>...</MediaTime> 
</VideoSegment > 

</VideoSegment id="seg2"> 

<MediaTime>...</MediaTime> 
</VideoSegment > 



} 6004a J 6002a 



} 6004b 



J 



6002b 



<VideoSegment id="seg20"> 

<MediaTime>...</MediaTime> 
</VideoSegment> 



}6004cJ 6002c 



</SegmentDecomposition > 

<MediaTime>...</MediaTirae> 
</VideoSegment> 



}6004d 



<!--Description of PointOfView DS associated with video structure- 
-> 



<PointOfView viewPoint="Team A"> 
< Value idref="segl" >0.3<Value> 
< Value idref="seg2">0.5</Value> 



6005 
•6006a 
■6006b 



<Value idref="seg2{T>0.8</Value> J 6006c 

FIG. 60 
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</PointOfView> 

<PointOfView viewPoint="TeamB"> } 6008 

<Value idref="segr>0.7</Value> } 6009a 

< Value idref= n seg20">0.2</Value> } 6009b 
</PointOfView> 

FIG. 61 



90 



EP 1 246 070 A1 



<M###########^^ 

<!-- Definition of HierachicalSummary DS --> 

<\-Mmmmmmmmmmnmnnmmmmmmuunmm--> 

<simpleType name="summaryComponentListType"base= "string" 
derivedBy="Hst"> 



<enumeration value="keyFrames"/> 
<enumeration value= "key VideoClips"/> 
<enumeration value= "keyAudioCIips"/> 
Enumeration value="keyThemes"/> 
<enumeration value= " unconstrained" /> 
</simpleType> 



> 6204 



J 



<element name="HierarchicalSummary" ^ 
type= "mpeg7:HierarchicalSummaryType"/ > 

<compIexType name= "HierarchicalSummaryType" \ 6200 

base= "mpeg7:SummaryType" 
derivedBy = " extension" > 

FIG. 62 
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<element name= n Summary ThemwList" 
type="mpeg7:SummaryThemeListType n 

minOccurs= w Cr/> 



> 6201 



<element name= "HighUghtLevel" type= - m peg7dHighlightLcvelType" | 62Q2 
maxOccurs=" unbounded" l> J 

<attribute name^^summaryComponentLisr i 6203 

type= w mpeg7:summaryComponentListType" /> J 

</complexType> 

FIG. 63 
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<\-Mmmmmmmmmmnmmmmummmmmmmm--> 

<!-- Definition of Summary ThemeList DS > 
<l-mmmmnmmmmmmmmmmnmUUmmmmmm--> 



► 6400 

J 



<element name="SummaryThemeList" 
type= "mpeg7:SummaryThemeListType7 > 
<compiexType name= "SiammaryThemeListType"> 
<element name="SummaryTheme"maxOccurs="unbounded"> 
<complexType base="mpeg7:TextualType"derivedBy="extension' , > J 6401 
<attribute name="id type" = "ID"/> 3-6202 
<attribut name="parentId"type="mREF"use="optiomal7> }6203 
</complexType> 
</eIement> 
</complexType> 

FIG. 64 
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< !-• Definition of HighlightLevel DS "> 



<element name= "HighlightLevel" 
ty pe= " mpeg7:HighlightLeveType" / > 
<complexType name= "HighlightLevelType"> 
<element name="HighlightSegment" 
type="rnpeg7:HighlightSegmentType" 

maxOccurs=" unbounded"/ > 
<element name= " HighlightLevel" type= "mpeg7:HighlightLevelType" 

minOccurs= " 0" maxOccurs= " unbounded" /> 
<attribute name=" name" type= " string" use= " required/"> 
<attribute name= " level" type= " integer" use= " optional"> 

Ottribute name= "duration" type="mpeg7:mediaDurationType" 

use= "optional" /> 
<attribute name =" themeIds"type="IDREFS"use= "optional" /> 

</complexType> 



V 6500 




FIG. 65 
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<SummaryThemeList > 
<Summary Theme y Xml : Iang="en; 

v [d= "itemO" ^ basebalI / </S^ummaryTheme> 
~6653i ' J~66(54a 

<Summary Theme i xml:lang="en"[d^"itemQj,° 

^arentId="itemO > ^ome^ b n > </SummfryTheme> 

. c 6605b _ 66Mb „ „ 

<SummaryTheme t xml:lang= en^ 

6602c 



y 6600 
6601a 

6601b 

6601c 



6601d 



id= "iteml T > v basketball<: /Summary Theme> 

6603c 6604c 
<SummaryTheme v xml:lang= " en ," j d = " iteml \ * 

parentld="itemi; > ( thre^poir^</SuWary Theme > 

6605d ^ 6604d 
<SummaryTheme ^ml:lang="en ; ^d=''iteml^ " v parentld= , 'itemr > v slam, 

vdunk^/SummaryTheme^ 6026 ^ g5 3« ^ 6605i ' 6604e 

6604e 

<SummaryTheme v xml:lang="en" 



3601 e 



6602f 

jd= ff jtem2; > v soccep< /Summary Theme > 
<Summary ThemeList > 



> 6601f 



FIG. 66 
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<HierarchicalSummary name= "keyThemesSummaryOOl" 
summaryComponentList= ff keyVideoClips keyThemes"> 
< Sourcelnf ormation idref = " mediainstancer / > 
<SummaryThemList> 
<Summary Theme xml:lang=*ed B id= ff EO w >slam dunk 
</SummaryThemfe 
<SummaryTheme xml:lang= "ed n id= "El" >3- point shots 
</SummaryThen£e 
</Summary The meList > 

<HighlightLevel name= " summary001 \themelds= " EOJ> 
<HighlightSegment>...</ffighUghtSegment> 6705a 
<HighlightSegment>...</HighUghtSegment> 
<HighlightSegment>..X/HighlightSegment> 
<HighlightSegment>...</HighlightSegment> 

</HighlightLevel> 
<HighlightLevel name= " summary002" themelds= "El" 
<HighlightSegment>...</HighlightSegment> 6705b 
<HighlightSegment>...</HighlightSegment> 
<HighlightSegment>...</HighlightSegment> 

</HighlightLevel> 
</HierarchicalSummary > 



J 



6700 



| 6703a 
6703b 



^6701 



FIG. 67 
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